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INTRODUCTION 


Growth of the United States air transportation system is 
currently facing two major barriers: energy and congestion. 

While the price of fuel has gone up by approximately an order 
of magnitude in the last 10 years, there is no assurance that 
fuel will continue to be available at the levels desired by 
the airlines. At the same time, lack of capacity at the major 
airports is causing delays to increase, both in number and 
duration. Both of these factors are causing the price of 
air transportation to reverse a 40-year-old trend and to 
increase in real terms, negating gains in aircraft productivity 
and engine efficiency. 

These considerations have led some observers of the 
aviation scene to conclude that the air travel mode is reaching 
maturity, although various regulatory, economic, and 
technological options have been suggested which offer 
incremental improvements to the existing system. For 
stibstantial growth to continue, however, major structural 
changes may be necessary. One imaginative and radical 
departure is the Aerial Relay System (Albert C. Kyser, "The 
Aerial Relay System: An Energy Efficient Solution to the 
Airport Congestion Problem," NASA Technical Memorandum 80208, 
January 1980) . 

Briefly, in the Aerial Relay System a series of "liners", 
made up of "line modules", continuously cruise over the 
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United States at- a set altitude and on a predetermined 
schedule. These liners are met by a fleet of "feeders" 
carrying aloft passengers boiond for cities along the liners ' 
routes and accepting passengers destined for their own base. 

The basic elements of the system are shown in Figure I. A 
ful^ly- developed Relay system could provide frequent non-stop 
service between practically any two cities in the United 
States . 

The advantages of the Relay system are many. The 
elements of the system can be tailored for their own function 
leading to efficiency of operation: the liners for cruise 
conditions, the feeders optimized for short-haul takeoff and 
climb. But the basic attraction lies in the Relay system's 
ability to lanload the major hubs' airports by utilizing 
secondary (or satellite) airports and smaller city airports 
for the feeder's operations; since one of the major functions 
of airports, especially those at large hubs, is the interchange 
of connecting passengers between airplanes, this transfer is 
now performed onboard the liners. The feeder from a smaller 
city or secondary airport takes up passengers bound for many 
destinations downstream (and accepts diverse passengers for 
the downward journey), bypassing the hub and relieving the 
hub of these operations. The Relay system would thus supplement 
and not replace the existing airline networks; the hub-to-hub 
origin- destination traffic could continue to be served by 
dedicated aircraft at the major airports. Alternatively, 
the Relay system could serve as the major link between 
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large hubs while utilizing satellite airports and thus 
relieving the major airports of this type of traffic. 

Thus the Aerial Relay System has intrinsic appeal, as 
it could both relieve congestion and decrease energy 
consumption of the air mode. Clearly, substantial 
engineering and design work is required before the system can 
be implemented. However, some questions regarding the 
fmdamental mathematical network properties of the Relay 
system can be addressed to insure that no basic drawbacks 
to the general concept exist. This report presents the 
derivation of a generalized algorithm which can be used for 
basic design studies of networks for the Aerial Relay System. 
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EXECUTIVE SUMMARY: 


THE RELAY SYSTEM NETWORK DESIGN PROBLEM 


The essential ingredients of an analytical approach to 
network design and analysis include the basic concepts of graph 
theory and flows in networks . Both are concepts which have 
received considerable attention in the literature. By the same 
token, the network design problem also has attracted the interest 
of a large number of researchers since its solution was thought 
to be relevant to the design of urban transportation networks . 

"Network Analysis" is the study of a given set of nodes and 
arcs that connect the nodes . The arcs represent the Relay 
system liner routes, and the nodes represent terminals or 
exchange points where the passengers /cargo connect from one 
liner to another. The origins of network analysis are old 
and diverse. Network analysts rely heavily on graph theory, 
a branch of mathematics that was founded by Euler in 1736. 

In the 1940 's operations research yielded a number of 
techniques, such as linear programming, for the mathematical 
study of network systems. Concepts of this kind, together 
with probability theory, statistics and computer programming, 
are the tools of network analysis. The factors which need to 
be considered in network analysis include the performance of 
the network, in terms of its economics, and the structural 
properties of the network, in terms of its vulnerability to 
disruption. 
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"Network design", on the other hand, is concerned with 
obtaining a good layout for the route network. In its simplest 
form, the classical optimal network design problem consists of 
building a connected "subnetwork" from a given large-scale 
hypothesized network. The subnetwork is developed by selecting 
a subset of links in the large-scale network that minimizes the 
sum of the shortest routes between all node pairs. A cost or 
"budget" constraint limits the number of links that may be 
included. The objective reflects the costs of using the network 
and the budget constraint limits the construction costs of the 
network. For example, it is conceivable that one may begin with 
a network grid for the Relay system sketched below, a regular, 
triangular pattern which completely covers the continental USA, 
irrespective of demand volumes and locations. Speeds are chosen 
so that vehicles can meet regularly at network nodes. A subnetwork 
of connected nodes can be built from the large-scale hypothetical 
network by applying the concepts of graph theory and flows in a 
network. 

This approach is the classical approach; others also exist. 

One of the simplest of these methods is called a "branch exchange." 
Here, we are given a set of nodes and their locations, and it is 
important to connect them by arcs in order to achieve a specified 
design goal. The method consists of modifying an initial network 
design using these nodes by repetitively removing branches and 
replacing them with the same number of new branches in new 
locations. The problem is difficult because of the many 

configurations that can be used to connect the nodes, but 
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computer programs are available which are capable of making a 
mmber of surprising improvements. 

Another approach is a heuristic design procedure which is 

similar to the philosophy of mathematical programming. The first 

step is to find some solution, regardless of cost, by any 

convenient means. Then, changes to this starting solution are 

considered and those which lower the cost are retained. We begin 

by choosing a subset of the service points, known as "key cities", 

that are spread across the entire country. A series of heuristic 

operations is then performed which improves the routing for 

circuits whose paths include a number of these key cities. After 

this has been accomplished, sections of the structure are 

sequentially removed and treated in the same manner. This is 

called "subproblem processing", a subproblem being similar to the 

entire problem but having fewer nodes and a set of requirements 

involving only these nodes. The subproblem establishes a 

desirable skeleton network on which to build the remainder of 
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the solution. The solution is modified by adding branches to 
provide alternate paths . In the resulting network all 
requirements are implemented along the path of shortest total 
length . Thus , this technique is tinlike the "branch removal" 
technique in that a solution is obtained by adding more branches 
to a subproblem, finding the cheapest path, and routing the 
requirements (liners) along it. 

We postulate a network pattern covering the United States, 
which will be flown by Relay liners. A daily schedule for 
liner flights exists such that meetings between liners occur at 
network intersections or nodes allowing passenger loads to be 
interchanged. There is a daily pattern for the volume of traffic 
flow between city pairs. At any time, an individual passenger 
can determine the best path from his origin to a desired 
destination consisting of one or more connected liner flight 
segments, and can make reservations to ensure available space. 

The problem is "Construct an economically- efficient network 
pattern and schedule of service", given: 

1) Liner speeds : 

2) Demand patterns between city pairs. 

The answers should consist of both a network pattern (or route 
map) and a timetable (or schedule map) for liner flights. The 
paths followed by individual liners , and the interchange of 
modules at intersections are also determined. A network flow of 
passengers, and a schedule of feeder flights, is also found. 

Thus, the Relay network development problem is classified 

as a "Network Design" problem. It turns out to be an extremely 
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difficult problem. An extensive review of existing methodologies 
in network design indicated that the "state-of-the-art” in 
existing mathematical techniques and computational capability 
cannot solve such a network design problem due to both 
complexity in its formation and the scale of the networks 
contemplated. 

The research reported here represents a step towards 
developing the required mathematical techniques . It extends an 
existing technique of the "branching" or "searching" category 
called "Implicit Enumeration" to the case where multiple 
optimization criteria can be specified. This was chosen as a 
point of departure for research since any mathematical 
technique for designing a Relay network will have to consider a 
variety of optimization criteria, such as minimum passenger 
travel time and minimxmi liner and feeder operating costs. An 
efficient computational algorithm has been developed and tested, 
but due to computational costs it is only successful on networks 
which are substantially smaller than the Aerial Relay network 
contemplated. Further research must be directed towards 
decomposition techniques where a sequence of smaller networks 
are considered. 
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SECTION 1 


BACKGROUND OF MULTI CRITERION 
PROGRAl'RIING 


1 . 1 The Network Design Problem 

It is clear nowadays that we can not solve all the pro- 
blems in terms of a single objective function. The complex- 
ity of daily life and the necessity of finding more real so- 
lutions will necessarily oblige us to solve problems with 
several objective functions at the same time. Thus, several 
solutions will . appear and the best solution of the problem 
will not be known with certainty and will depend upon the pre 
ferences of the decision maker. 

There are many areas in which we can apply this class 
of problems. Multiobjective problems can be found in areas 
such as Financial Decision Making, Educational Planning, 
Transportation Systems, Production and Inventory Planning, 
etc... Of all of these, Transportation is one of the most 
important areas in which a multicriterion framework can be 
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applied. In Air Transportation for example, there is a large 
number of criteria to be considered: decrease travel time, 

decrease total costs or simply fuel costs, improve safety and 
comfort, enhance air quality and reduce noise impact, etc... 

An area in which a multicriterion framework had been al- 
ready suggested is Transportation Networks Design. Agarxcal 
[l] , presents the application of two interactive optimization 
techniques to the design of transportation networks under 
multiple objectives. He makes an excellent discussion of the 
importance of considering more than just one single criterion, 
which most commonly has been the minimization of costs. 

He suggests a representative list of criteria which is 
reproduced below' and sets up an example of a transportation 
network design. 

1. Decrease Travel Time. 

2. Decrease Travel Cost. 

3. Improve Other Service Characteristics. 

4. Improve Safety. 

5. Increase Accessibility. 
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6. Provide comparable transportation services to all 
segments of the population in relation to their needs. 

7. Provide transportation facilities and services to 
encourage development in accordance v/ith comprehensive plans 
and to control development to support transportation plans . 

8. Enhance air and water quality. 

9. Minimize expenditures of public money for the cons- 
truction and operation of transportation systems. 

10. Minimize constimption of energy/fuel supplies. 

11. Minimize noise impact. 

12. Enhance property values. 

. 13 . Decrease personal tax burdens . 

14. Minimize dislocation and permanent disruption of 
neighborhoods . 

15. Minimize disruption due to construction activities. 

16. Improve quality of neighborhoods. 

In essence, the problem is stated as the one of selec- 
ting the best combination of development projects which pro- 
duces the best traffic network, evaluated in terms of given 
criteria while maintaining expenditure within the given bud- 



The criteria suggested by Agarwal in his problem are: 

-Minimizing Total Travel Time. 

-Minimizing Total Construction Costs. 

-Minimizing Total Vehicle Miles. 

-Minimizing Total Mimnber of Dwelling Units Taken For 
Rights-of-way Over The Entire System. 

The problem formulated is then solved using Geoff rion 
et. al. [ 23 ] and Benayoun et. al.[3] interactive approaches. 
Agarwal concludes that both procedures are promising in the 
application to the design of transportation networks and 
suggests the extension of his results in some other areas. 


1 . 2 The Vector Maximum Approach 

An important and basic element for any approach to the 
multicriterion programming problem is the concept of a ncn- 
dominated solution. Before studying this concept, we will 
first expose the following concepts provided by Yu and Ze- 
leny [46]. 

Let G(x) = (fj^(x) , . . . ,fp(x))^ denote a functional set of 
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p criteria defined over the decision space S, S CR^. Given 
a point in the criteria space, say g £ G c R.^ , we could asso- 
ciate with it a set of domination factors, DF(g), such that 
if g’^ g, g’ and geG, and g'egBDF(g), then g' is dominated 
by g. The symbol ^ means that the addition operation is 
done over all the elements of the set. An example of a DF is 
a p-dimensional vector d, with the property that if g'= g+ ud 
where u>0, d£DF(g), then g dominates g'. It is clear that 
any positive multiple of d is also a DF. 

A nondominated solution is one that is not dominated by 
any other feasible choice. For instance, g' is a non-domina- 
ted point if for all geG, u>0, and d£DF(g) 

g'f g + ud 

Among the different approaches to the multicriteria pro- 
gramming problem is the vector maximum approach. This ap- 
proach tries to find or generate all the efficient solutions. 

EFFICIENT POINTS: A point x° £ S is said to be efficient 

if there is no other point x£S such that G(x) ^ G(x°), with 
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at least one strict inequality. We can see that x° is a non- 
dominated solution, with respect to DF(G(x)). 

DF(G(x)) = I d e rP, d ^ 0 } 

The vector tnaxiinuin approach tries to generate all the 
points x*^£ S, such that there does not exist another xeS, 
satisfying 

G(x°) = G(x) + ud u >0 
and d^^ 0 , i = 1 , . . . , p 

It is important to notice that the vectors d, can be 
regarded as feasible directions of dominance, because if 

G (x) + ud = G (x ' ) 

then, since ud ^ 0, G(x) ^ G(x’). 


THE 0,1 MULTICRITERIA PROBLEM 


Multiple objective programs xv’ith continuous variables 
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have been exhaustively treated in the literature. However, 
very little has been done for the zero-one case. 

The linear multiple objective problem with zero-one va- 
riables is written as 

(P) Max Cx : x £ F } 

where F = { xSR^ : Ax^b, x^=0,l j£J } , C is a pxn 
matrix, A is a mxn matrix, b is a mxl vector and J = l,...,n 

The solution set to (P) is the set of efficient points 
denoted by EF (P) . Specif icically x° £ F is said to be effi- 
cient in P, if there is no x£p such that Cx ^ Cx° with at 
least one strict inequality. From this point on, the partial 

ordering relation x ^ y, will mean x.^ y . , j £J with at least 

J 

a strict inequality. 

A typical practical application that can be reduced to 
this model is the "Project Selection Problem". The columns 
of A corresponds to projects to be selected or rejected 
by p interested parties on the basis of the pxl evaluation 



vectors C'^ (the columns of C) . 


A central difference between convex and discrete multi- 
ple objective programs is that in the former case, if the 
Kuhn-Tucker constraint qualifications hold, every efficient 
point i (?) maximizes a linear functional of the type XCx, 
for a XeR.P, X>0, on the feasible set. In the later case, 
this may not happen as is shown in the example below: 



x^= 0 , 1 and x^= 0 , 1 


The point ~ is efficient in the last pro- 
blem but does not maximize a functional \Cx, for any 0, 

on F. This type of points is what Sitran [ 9 ] defines as 
weak efficient points. Conversely, a strong efficient point 
is one that solves the problem max |xCx} xsF, for a given 
set of weights X . 


As we have seen, not every element of EF(P) maximizes 
a functional of the type XCx, V7ith X ^ 0, on F. However 
for any X>0, every solution to 

(?x) Max I XCx : x e F } 
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is efficient in (P) . The linear functional XCx corresponds 
to the assignment of weights to the p criteria. As these 
weights are ussually subjective, it would be useful to in- 
vestigate the set of weights for which a given element of 
EF(P) solves (P;^). 

Similarly to what is done in Kombluth's paper [S2] on 
the continuous multiple objective linear program, we charac- 
terize, for the zero-one case, the indifference set 

S = I X e Rp : X] 1; 0, i = 1 p 

( i=l 

where x^£EF(P) and S(x^) = | XeS : x^ solves (P;^) } 


1 • 3 Algorithms for Linear MultipleOb jective Programs 
1.3.1 Zero-One Variables 

An algorithm for finding the efficient solutions for 
problem (?) x>?as developed by Pasternak and Passy [39] . They 
studied problem (P) for the case of two criteria and presented 
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an algorithm based on a parametric approach combined with an 
extension of Balas filter method. They applied the algorithm 
to solve the project selection problem and reported the so- 
lution in [13]. 

Shapiro [41], presents basic theoretical results that 
provide a means of generating efficient solutions to the pro- 
blem, based upon integer programming duality theory. However, 
he does not provide a procedure that generates the entire ef- 
ficient set of integer solutions. 

Bitran [ 9,10 ], has developed basic theoretical results 
as well as general procedures for obtaining the efficient set 
of solutions to zero-one multicriteria programming problems. 
Both methods are based on the study of the auxiliary problem 

(P') Max I Cx:Xj=0,l jsd 

and in the generation of auxiliary vectors that are, after- 
wards, mapped into the set of non-efficient and efficient so- 
lutions of the problem. 



The aiixiliary problem (P') is clearly related with the 
original problem (P) , since every efficient point in (P') 
that is feasible originally, is also efficient in (P) , 

The general scheme is based on the generation of vectors 

V c R” such that v = (v, ,...,v ) , v.= 0,1 or -1 and cv ^ 0 . 

i n j 

These vectors are considered as directions of preferences. 

For instance, if x = x' + v, then, since cx = ex' + cv; 
cv - 0, we have that cx ^ ex', or x dominates x' . Obviously, 

cx = ex' + (-cv) 

In both methodologies, Bitran relates the vectors of 
preferences with the set of efficient and non-efficient so- 
lutions for the auxiliary problem (P'). In the first proce- 
dure [ 9 ] , he employs the following mapping for such purpo- 
ses : 

V . = 0 — > X . = 0 and 1 

J J 

v.= 1 — > X = 0 

J j 

v.=-l — x.= 1 

J J 

where v and x e space. 

This map relates the set of vectors, v, with the set. of 
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dominated points of the auxiliary problem (? ' ) . 


As a by-product of the results, an algorithm to deter- 
mine EF(P) was obtained, however, its applicability was li- 
mited to small problems. 


In the second approach [ lO] , Bitran uses another map- 


ping: 



— > x.= 0 and 1 
3 

— > X = 1 

j 

— > X = 0 
3 


In this case, the set of vectors vd space, is related 
to the set of efficient points of (P ' ) . In both schemes, the 
generation of the vectors, v, is done via implicit enumera- 
tion. 


Once the set of zero-one efficient solutions for problem 
(P ' ) is determined, Bitran proceeds to relate this set with 
that of the original problem by checking feasibility. The 
efficient points of the axnciliary problem that are feasible 
in (P) , are efficient points of (P) . Finally, the set of 
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efficient solutions of the original problem is completed 
through the identification of those non-efficient points for 
(P') which are part of EF(P). 

The algorithm is presented in terms of a directed graph 
having as modes the vertices of the unit hypercube, which are 
either isolated nodes or end nodes of d-paths, and as arcs a 
subset V of V, the set 

V = | v£R^;Vj=0,lor-l jeJ, cv^O 

The approach that uses the first mapping is denoted as 
the forward algorithm. The other is called the back-wards al- 
gorithm. 

Computational evidence reported by Bitran shows the su- 
periority of the backwards algorithm. A detailed analysis of 
the computational time spent in the different parts of this 
algorithm reveals that the backward parts are those which 
consume the most time and which limit the algorithm to a 
relatively small number of variables. 
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1.3.2 A Dynamic Programming Approach 


A new approach to solve multicriterion integer linear 
programming problems is the one presented by Villarreal and 
Kar^^an [44 ] . 

The algorithm is essentially an extension of the funda- 
mental dynamic programming recursive equations. In the se- 
cond part of their paper, relaxations and fathoming criteria 

which are fundamental to branch and bound procedures are sug- 
gested to obtain an alternate hybrid approach. 

The problem is formulated as follows; 

N 

(P) v-max ^2 c^ x^ 

n=l 

N 

subject to aP- x b 

n=l “ 

^ X s 0 INTEGER 
n 

A transformation in the set of constraints is done in 
order to make the problem suitable for a dynamic programming 
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approach . 


In the first part of the paper, three different recur- 
sions are presented. 


The first recursion enables them to find the set n(Yn) 
of efficient solutions for the n-stage problems with a vector 
of resourses Yn from the set Hn-1 (Yn-1) of efficient solu- 
tions for the (n-1) stage problem with a vector of resources 
Yn-1, and Ho (Yo)= |0} for all Yo. The set of constraints 
have been transformed to: 


n-1 




a’^ X, 


n 


K s X s 0 INTEGER 
n n 


Using this recursion they can obtain the sets of solu- 
tions for any right hand side vector {O } ^ Yn ^ b for any n- 
stage problem. They have to be applied for n=l,...,M and 
each vector of resources Yn. 

An alternative recursive formation is suggested. The 
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recursion starts at Y= |o} and then, proceeds increasing the 
values of the vector, Y, until Y=b . This procedure can be 
used to obtain the set of efficient solutions for each vector 
of values, |o}^Y:s |b| , at stage n=N, Thus, a basic dif- 
ference between this recursion and the first one is that it 
is not necessary to go through each stage n( ^ M) , in order to 
obtain the set of solutions for any vector, Y, at stage N, 

These two recursive formulations require the explicit 
determination of the vector of resources Y. This implies 
that each vector, Y, must be identified with its correspon- 
ding set of efficient solutions, and hence as the number of 
constraints increases, the necessary storage requirements are 
increased enormously. Another recursion is suggested to ale- 
viate this problem and consequently they develop a procedure 
that can be used to obtain the set of efficient solutions for 
any vector of resources, |o} s Yn <: b , such that there will 
not be any requirements to explicitly define any of the vec- 
tors of resources until the last stage (N) . 

The procedure considers first all the possible feasible 
values of Xn at stage n, n=l,...,M, producing n-dimensional 
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points by combining feasible values of Xn with the (n-1) -di- 
mensional efficient points. Then, after eliminating all of 
those n-dimensional points which are infeasible, the set of 
efficient solutions of the problem at stage-n, is obtained 
via pairwise comparisons. 

In the second part of the paper, a dynamic programming 
hybrid approach is presented, by introducing bounding proce- 
dures . 

An efficient solution for the n-stage problem, with re- 
source consumption vector Yn is said to be fathomed by boun- 
ding when its functional set value <5 an upper bound of the 
residual problem is less or equal than any member of the set 
of lower bounds . 

Different techniques for finding upper and lower bounds 
are reviewed and some of them are coded in a new algorithm. 

An important issue that they take into account is the 
trade off to be made between the benefit that more bounds 
provide, eliminating possible solutions, and the price that 
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has to be paid for calculating these bounds. 


It is interesting to see hov; the solution time varies 
with the nxmber of bounds performed. Villareal and Karwan 
analyze this problem for a multiobjective function (p=2) and 
a size of 10 variables and 10 constraints. 

Different problems were run several times, the first one 
with no bounds, the second one with two lower bounds, the 
third with three and the fourth with four lower bounds . The 
decrease in solution time between the first run and the se- 
cond one was of about 93,7%. One more lower bound decreased 
the time of solution by 27,5% over the previous one, and only 
in four out of ten problems. A fourth lower bound decreased 
the solution by only 9,9%. The six remaining problems' time 
solutions already begin to increase in the moment they per- 
form the third bound. 

Then, depending upon the kind of problem, V7e can draw 
the typical graph (Figure 1) of the variation of the solu- 
tion time with the number of bounds. There will be a point 
for which the solution time begins to increase. 
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Figure 1. Variation of solution 



NU1I3ER OF BOUInDS 
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Finally, computational experience is reported. In using 
the hybrid dynamic procedure, the heuristic developed by Lou- 
lou and Michaelides [36] was applied to obtain sets of lower 
bounds to the original problem. This proved to be very use- 
ful since many of the bounds generated turned out to be ef- 
ficient solutions. The sets of upper bounds for the residual 
problems, were determined by setting each of the remaining 
variables to their upper bounds. The reduction in the solu- 
tion time of the problem was proved significant. In parti- 
cular, for those with b-value equal to 0.75 times the sum of 
the associated row coefficients. 

Villarreal and Karx^7an end up saying that the interac- 
tive branch and bound approach gives the best computational 
time . 


1.3.3 Other Algorithms for M.P.P. 

Zionts and Wallenius [4S] and Zionts [49 ] present theo- 
retical results, algorithms and computational experiences for 
the versions of (P) where F is a finite discrete set given 
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explicitly. 

Two methods are offered: one is based upon cutting plane 
theory, and the other uses branch and bound ideas. The ini- 
tial step of both procedures is to solve the linear relaxa- 
tion of the problem. If the solution satisfies the integra- 
lity constraint, it is the optimal solution and the procedure 
stops. Otherwise, one must continue until satisfying inte- 
grality. The procedures differ only in the way they achieve 
this goal. Zionts recommends the use of the branch and bound 
algorithm based upon prior experiences reported with similar 
algorithms for solving single objective problems. In both 
procedures it is assumed that the decision maker has a linear 
additive utility function. This utility function is not en- 
tirely or necessarily kno^m. 

The technique developed by Zionts is analogous to the 
work of Zionts and Wallenius, except that the set of decision 
is discrete, finite and explicitly given. The final result 
is not a solution but, a collection of solutions that the 
manager appears to prefer over the others. 
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The technique consists of two phases. In the first 
phase an efficient solution is found. Next, an arbitrary 
set of xi/eights is selected to start and each alternative is 
evaluated. The one that maximizes the corresponding linear 
functional is selected and every efficient adjacent decision 
is generated over it. 

The procedure is repeated by posing new trade offs to 
the decision maker at the current solution. The method con- 
verges to the optimal solutions for the unknown overall uti- 
lity function in a finite number of iterations . 

If the true utility function was knoi^m, we would use the 
objective values of the solutions to decide branching rules. 
Kox^ever, this is not possible, since we have only the approxi- 
mation. Under the assumption that the decision maker knows 
implicitly his preference weights, the decision may be based 
on his responses to where he would rather continue branching. 
This is valid since it implies that the best preferred solu- 
tion will have the greatest utility for the decision maker. 

For instance, if the solutions x and y are available and x 
is preferred to y, then Xcx > Xcy, where X denotes the true 
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set of preference vreights . Notice that Xcx > \cy does not 
necessarily imply that cx cy with at least a strict inequa- 
lity. However, the preferred solution in this case must be 
a member of the set of efficient solutions of the problem. 

As a matter of fact, it must be a strong efficient point. 


28 




SECTION 2 


A RSVIEW OF INTEGER PROGRAI-MING 
FOR A SINGLE OBJECTIVE FUNCTION 


Among the most general approaches to the solution of 
mixed-integer optimization problems is the Branch and Bound 
method. The Branch and Bound method is nothing more than an 
intelligently structured search of the space of all feasible 
solutions. Most commonly, the space of all feasible solutions 
is repeatedly partitioned into smaller and smaller subsets, 
''Branching”, by a basic tree enumeration method which involves 
calculating upper bounds and lower bounds, "Bounding", on the 
objective function in order to be able to find the points in 
which no further exploration can be profitable, "Fathoming". 
The utility of the method derives from the fact that only a 
small fraction of the possible solutions needs actually be 
enumerated. 

As a special case of the Branch and Bound method, we X7ill 
focus our attention upon the one used to solve binary variable 
problems, where all the integer variables are required to be 
0 . 1 . 
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2 . 1 Implicit Enumeration 


Implicit enumeration is the name of a class of Branch and 
Bound algorithms designed specifically for the case in which 
X is required to .be a binary vector. 

(P) Min 2 = cx 

s . t . Ax ^ b 

X = 0,1 (Binary) 

We can also assume, with no loss of generality, that 

c^O, since any x. with c, ^ 0 can be replaced by x' = 1 - x 

J J j j 

Balas [bJ, characterizes his algorithm as 'additive' be- 
cause no multiplication or division are required. He applied 
his additive method to mixed integer programming with zero- 
one variables, where u is a solution of the problem (P) , 

The fundamental idea underlying the algorithm runs in 

the following lines: He starts with the relaxation of the 

binary constraints, problem (P ) of solution u . 

o o 

Starting with all n variables equal to 0, the algorithm 
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consists of a systematic procedure of assigning the value 1 
to some of the variables in such a way that, by following some 
branches of the tree, and after trying a small part of all the 
2^ possible combinations, one obtains either an optimal solu- 
tion or evidence of the fact that no feasible solution exists. 

At a stage k, the solution u‘^ is then uniquely determined 
by the set 



Balas bases his computation on trying to find the new 
vector to be introduced into the basis at a stage k + 1, 
(BRANCHING). According to certain rules, he chooses the next 
variable to be introduced as a constraint from the set of im- 
proving vectors, of the solution u,^. This set, N^, is 

essentially the set of points which being still free, j Si^^, 
if introduced into the problem, the value of the objective 
function won't hit the ceiling z,^ for Uj^ (BOUNDING). 

VJhenever a solution Ug is reached, only the improving 
vectors for that solution are considered for introduction into 
the basis, wlienever the set of improving vectors for a so- 
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lution Ug is found to be empty that means there is no feasible 
solution Uj. such that Zj,<Zg. In such cases we have to take 
up our procedure from a previous solution u^. 

An essential feature of the Bales algorithm is the tes- 
tine of the bounding problems for infeasibility. Each linear 
constraint is examined to see if it can be satisfied by set- 
ting some variables to its more favorable value. If, 

, .^0 

>0 

• • 

does not hold for every i, no completion of can satisfy 
constraint i and we can fathom this point . 

The Bales Algorithm terminates when a solution has been 
reached, for which a) there are no improving vectors for any 
Uu, b) inequality (1) does not hold for any k such that ? 0 
and c) we can not back up any more. 

Although Bales first put the fundamentals of the algo- 
rithm it was Geoffrion who clearly defined the implicit idea 
of Bales [zo] . 


k 

a. . ^ y . 


a. j If a 


0 if a 
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A partial solution is defined as an assignment of bi- 
nary values to a subset of the n variables. Any variable not 
assigned a value by is called "free". 

A completion of a partial solution, is defined as a so- 
lution that is determined by S^, together with a binary spe- 
cification (0 or 1) of the values of the free variables. 

Using Garfinkel and Nemhauser [iS] , notation, we can de- 
compose the set of assigned variables into two different sets: 

sj = j ; j e and x^= 1 | 

I = j : j eS^ and x^= 0 

F^= j j 

Then, for a given partial solution we can determine 
the "best" feasible completion (the one that minimizes cx 
among all feasible completions of S^) . If such a best fea- 
sible completion is better than the best knoxro feasible solu- 
tion, then it replaces the latter in store. The best feasible 
solution found so far is called the "ceiling” by Bales or 
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the "incumbent” by Geoffi'ion. We will call it the upper 
bound Zq if we are in a minimization, and the lower bound Zq 
if we are in a maximization. Another possibility is that we 
may be able to determine that has no feasible completion 
better than the incumbent. In either case, we shall say that 
we can fathom this point. 




Min z. = ^ C.X.+ c. 

jeFk J ^ J 


k 


.t. 2 a.,x 5^b.- S , a, .= y 


We 


want to find the best feasible completion of S^. That 


is trivial, just take x^= 0, or 1, for each free variable ac- 
cording to the sign of his coefficient. For convenience, we 
asstmied that c^O, so that each free variable may be taken to 
be zero. We will call the value of Zk, obtained as described, 
a bound of z^, in a minimization and Zk in a maximization. 


This value can be feasible, in that case this bound is 
then the best feasible completion of S,, . As the computations 
proceed, the value of the incumbent feasible solution gives 
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a hopefully good upper bound on the optimal value of (?) , 

that can be used as indicated below. Until the first feasible 

solution has been formed we take z = « 

o 


If the best completion is not feasible, we do nothing 
further to find the best feasible completion. Instead, we 
attempt to determine that no feasible completion of is bet- 
ter than the incumbent. If this is actually the case, then 
it must be impossible to complete so as to eliminate all 
of the infeasibilities of and yet improve upon Zq. To 
demonstrate this impossibility, it is clearly sufficient to 
contemplate non-zero binary values only for the variables in 
the set 



j er. 


cx. 


c . < z_ and a . . > 0 
J ° 


for some 



because in order to give a value of 1 to some free variable 

not in T, would either lead to a higher value than z or 
X o 

would not contribute to diminishing an infeasibility of Xv 
(v;e have made use of our assumption that c^O). Hence, if 
is empty then there could be no feasible completion of 
that is better than the incumbent, and the point is fathomed. 
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set 


In fact, the set of Geoffrion is equivalent to the 
of improving vectors of Balas . 

It is also easy to see that the same conclusion holds 
for the fathoming for infeasibility case of Balas 

yV + 2^ Max (0,a. .) ^ 0 

j Tk ^ 

for some i such that y^<0; for then there could be no way 
to select free variables so as to eliminate infeasibility. 

For the augmentation mechanism, one choice is to augment 

S, by one variable from T, . As the same as Balas, the vari- 

iC 

able that leaves the least amount of total infeasibility in 
the next x, in the sense of making 

m 

^2 Min (yj^ ■*" . 0) 

i=l ^ 

an algebraic maximum, over all j e Tu . 

As we have seen, Geoffrion is dealing with two kinds of 
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We must realize that the value of the optimal solution is 
going to be between these two bounds and depending upon if 
we are in a minimization or in a maximization, these bounds 
are exactly the opposite of each other in the way that we have 
to find them. 


For instance, in a maximization, an upper 

may be calculated by taking each free variable 

In a minimization a lower bound z. = z'^ may be 

-J J ^ 


bound z^ $ z. 
to be 1 (c ^ 0) . 
calculated by 


taking each free variable to be 0. 


Again, the fathoming cases are 


<a) Zk = Sk 

(b) ^ ^ Zq (minimization) 

Note that (a) occurs v;hen x,. is feasible to P, , and no 
better solution can be found. I’Jlien case (b) occurs, no suc- 
cessors of k can yield a solution that improves on the best 
known solution to P. Note also, that the case Ti^= 0 is in- 
cluded in case (b) , since . 
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2 . 2 Additional Tests for Implicit Enumeration 

A.n interesting result due to Zionts [47] is the use of 

his Extended Geometric Definition Method in the Balas algo- 
rithm. The E.G.D.H. is a means of computing and recomputing 
upper and ower bounds on both primal and dual variables of 
linear programming problems between simplex method iterations. 


For our problem 


Min 


n 

z 


c .X. 

J 2 


n 


E 


a..x. + X b. i«l, . . . ,m 

2 n+i X 


Zionts finds the following bounds: 


-A LOI'TER BOUND for a SLACK, variable x . is given by 

n+i 


n 


h , .= 

n-T' 


. = Max I 0 , b . - 
^ ^ k=l 


ik 


-An UPPER BOUND for the same SLACK variable will be 


n 




^ k=i 
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where 


+ 

a. . = 

a if 

a >0 


a. . if 

a. , 

^ 0 


ij • 

a7. = 




j 

0 if 

a. . ^ 0 

^3 

0 if 

a. . 

iJ 

>0 


-A LOWER BOUND for a ZERO-ONE integer variable will be 


h. 

2 


Max jo, (b^/a^^) -(1/a, 


- .) ( a?, + u ) I for a, . 

ij i^_j n+i J ij 


> 0 


' Max 


|o, (b,/a,.)-(l/aij)( E + j 


for a. . < 0 / 
3-J 


-An UPPER BOUND for the same BINAP^Y variable is 


u , 

J 


(b.M + 

-J k=J 

(b./aij)-a/a..)( E a^j, + 


iJ k= 


:or a. . > 0 
ij 


for a^j < 0 


And in the case of equality constraints u , h .=0. 

n+i n+i 

Note that the application of these bounds can be made for 

L- 

partial solutions by computing y^ instead of b^. Then of 
course, only free variables are considered in the computations 


By using these results to generate upper and lower bounds 
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on the variables we can apply them to the Implicit Enumeration 
Method. 

-If a lower bound greater than zero, but less than or 
equal to one, is found for some variable x^, then this inte- 
ger variable is implied to be one in all continuations of the 
present partial solution. 

-If a lower bound greater than one is found for some va- 
riable Xi , then there is no feasible continuation. 

-If an upper bound less than one, but not less than zero 
is found for some variable x, , then x,, is implied to be zero 
in all continuations of the present partial solution. 

-If an upper bound less than zero is found for some va- 
riable x^^, then there is no feasible continuation. 

-If all upper bounds are at least one and all lower 
bounds are at most zero, then no tighter bounds are available. 

Actually, the calculations of the upper and lower bounds 
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can be simplified tremendously by the elimination of tests 
which cannot occur, and avoiding repetitious calculations, as 
we will explain later. 

Another important point in the implicit enumeration al- 
gorithm is the choice of the partitioning variable. C, Lemke 
and K. Spielberg [35], analyze the computational advantage of 
some modifications of Salas' algorithm, in particular the is- 
sue of the preferred row and the preferred variables. 

In order to choose the next variable to be fixed, they 
constructed a preferred set of variables for each row » 

and defined the preferred row as the row for which Tj,(i) has 
the minimal number of entries. In the tree search a preferred 
row is associated with each point of the tree when that point 
is reached for the firss time. Then, and also at every sub- 
sequent return to this point, the preferred set for this row 
is established and a forward branch is selected from the in- 
dices in this set only. 

They also applied the concept of "complete enumeration", 
of which we will now give an example. 
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For each constraint i, 0, find the Gomory cut. 

This is nothing more than taking all variables with positive 
coefficients to zero. 

+3X2 “Sx^ -x^ +4x^ ^ -3 

- x^-3x3 - ^ -3 

This tells us that some of these three variables have 
to be set at one. Furthermore, we can determine v;hich of the 
three it is. 

Put all variables in order of decreasing coefficient and 
systematically fix x^= 1, beginning with the one which has 
the greatest coefficient.- 


X, -X, -5x^ 

14 3 


-3 

-^4 -=='3 


-2 

-5x3 


-1 

^3 


1/5 


kTiat we have found is only a lov7er bound for variable x^ ; 
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the same we would have obtained using Zionts' test. Being 
as how h^= 1/5 >0, this means that has to be set at one. 

They have found that this procedure substantially reduces 
the number of points to be considered, as well as the compu- 
ting time. 

As we will soon see, the solution time increases expo- 
nentially with the number of variables . This is a reason why 
the Zionts test for finding upper and lov;er bounds in vari- 
ables, explained in Part Two of this section, have such great 
computational advantages. 

In fact, any branching rule taking into account feasi- 
bility, will lead us to choose the same variable as in Zionts' 
test, but the advantage of one in respect to the other is 
clear. Ziont's test will tell us that a variable has to be 
set at a specific value. Instead, the branching rule will 
recommend us to take this variable to the same value. After- 
wards, when we check the other branch of the tree, where this 
variable takes the opposite value, we will see that this branch 
is infeasible, but we will have lost more computational time. 
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C. Lemke and K. Spielberg, in their complete enumeration 
of each constraint, are doing the same as Zionts. In fact, 
they find the lower bound for only one variable, the one with 
the most negative coefficient. This suggests to us that it 
is not necessary to find all the lower and upper Zionts bounds 
for all the variables, but rather, for only some preselected 
variables that we will now try to identify. 

Consider the problem 

Max cx 

s . t . 

Ax ^ b 

X = 0 , 1 


where all c,, ^0. Then, to maximize cx we would like to set 
all variables at 0. This normally won't give us feasibility. 
So, our goal is to look at those constraints with b^. 0, and 

find Vvhich variables have to be set at 1, in order to make 
the problem feasible (b^>0), because in this moment, the im- 
plicit enumeration algorithm will stop, taking all the rest 
of the variables to 0. 
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■ So, we only have to analyze constraints i £ where 


is the set of i : y. < 0. Among the constraints, we begin by 

X 

analyzing the variables in the set R^, the set of j : a^^<0, 


A lcv7er bound in this case v;ill be 


h . = Ma>: 
J 


So, we v;ant 


0, (b,. /a. .)+(l/a. .) £ a~ 


>0 


< 0 


b. + 
1 


3. 0 — > ^ r/ 


k4j 


lie 


k4j 


f \k< 


Ea - 


and that (b . t ZmJ aT, / a. . ) be as big as possible. To 

k:i=j 


aT, >0, 


To achieve this, we need to have JLj a., >0, as small 

k^j 

as possible, and a^.j<0, as small as possible (the most nega- 
tive number) . 


To find which variable to test, we can continue as fol- 

lows: Reindexed constraint i so that the coefficient a., be 

iJ 

in non-decreasing order. 
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We can define T (m) 


m) s - • f 

* 1, ^ j 


and find T. (m) for each 


j=hn 


variable me R“ beginning with the q = Max la. .1 , (the first 


j.p- 


variable in the reindexed constraint i) . 


We will find p, such that T^(p) < )b^i < T^(p-rl), and test 


all the variables between p and q = Max la..j . 


A simplification would be to test only for variable q. 
If for q, T^(q) = ^ ^ aT. >lb^| , we know that not only h <0 


but rather any other variable j such that v;ill 


have 


2 a:^ > Z) 


Z a: 


k=J=j 


k+q 


^ Z-/ aT. > !b.) 

k+j 


So, it will have h.<0. 

J 

Unfortunatly , this is only a necessary condition, be- 
cause if it is true, it is possible that h^<0, and another 

variable j have h.>0. 

J 

On the other hand, w*e dont need to find any upper bound 
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for any variable in R~, because this will tell us that some 
variables have to be set to 0 and this is automatically done 
by the implicit enumeration method. 

We would also like to find a lov;er bound for the varia- 
+ 

bles j eR , the set of j : a..>0, to see if it is necessary 
k 3-J 

to set some of them at one: 

h . - Max 
J 

<0 >0 

So, we don't have to find any lower bound in this case, 
because it will always be less than zero. By the same reason 
as before, we do not need to find any upper bound for these 
variables . 

Thus, we can conclude that complete enuneration, or fin- 
ding the lower bound for variable q = Max la. .| , which is the 

same thing, is a very good approximation to the Zionts test. 


0. (b./a.j)-(l/a.j) 


E 

k=#j 
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2 . 3 Computational Experiences 


The ultimate practical usefulness of any integer program 
ming algorithm depends on the critical question: "Kow fast do 
soultion times increase with the problem size?” The number 
of variables is perhaps the main determining factor for im- 
plicit enumeration algorithms, since the number of possible 
solutions of (P) is 2^‘. 

Ne are going to measure the problem size by two varia- 
bles: n: the number of variables, and m: the number of con- 
straints. Then we define the problem size by n,m. 

The inicial Balas algorithm modified by Fleischmann [l6] 
gives us some interesting results. As we can see in the next 
graph, for the type of problems analyzed by him, while the in 
crease in time solution is more or less linear as we increase 
m (keeping n constant) , the increase in solution time is very 
rapid when we increase n (keeping m constant) . 

Two facts are interesting tc point cut: 

-The increase in solution time with n for a given m, is 
produced in a very short period of n. 
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FIGURE 2. 


FLEISCm'IANil: COMPUTATIONAL EXPERIENCE WITH 

THE BALAS ALGORITlG-1. 




y 

y 

y'' N=30 (Predicted) 


-The increase in solution time with m for a given n, 
(slope of the line) , is increasing v;ith n. 

Another important issue is that the solution time is go- 
ing to depend very much not only upon the size of the problem 
(n,m) and of course, the type of computer used, but also on 
the kind of constraints analyzed. Fleischmann analyzed a kind 
of problem of m-1 constraints of the type 



j e S 


which gives him the possibility to have good computational re- 
sults at (50,11) and (44,23), (solution time on the order of 
one minute). But even that kind of problem blew up at (60,32), 
13 . S minutes and (80,11), 30.6 minutes using an IBM 7094. 

Now let's analyze the computational impact of the dif- 
ferent tests studied before. 

Geoffrion [2l] , analyzed several problems with surrogate 
constraints and got very good computational results. Each 
problem was run twice, once skipping the step so that no sur- 
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rogate constraints were ever computed, and another X\rith the 
step fully implemented so that an attempt X7as made to compute 
a new surrogate constraint each time. The average reduced 
solution time x-zas about 80%. In fact, problems such as Flei- 
schmann's were reduced by 99.5% Problems on the order of 
greater than 10 minutes were reduced on the order of seconds . 
The (80,11) Fleischmann problem was reduced to 0.03 minutes. 

These results indicate that the use of the imbedded li- 
near program of Geoffrion greatly reduces the number of re- 
quired iterations, but even with this device, the algorithm 
did blox>r up in a (74,37) problem. It does not matter, there- 
fore, how improved our algorithm is, there is going to be a 
moment in which the solution time is going to bloxv up, and 
normally within a very short range of n. All the tests al- 
ready explained effectively decrease the average solution 
time but these tests are normally good for a specific kind of 
problem, and maybe for another problem of the same size might 
blox^^ up 

Given that we have seen that one or the draxvbacks of the 
algorithm is the number of variables n, the Zionts [47] test 
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for bounded variables can give us good reductions in solu- 
tion times . The number of partial solutions computed was also 
greatly reduced by an average of about 70%. Although given 
that Zionts only solved very small problems of size (12,6), 
we really do not know how this test will perform on large 
scale problems. 
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SECTION 3 


AN APPLICATION TO THE MULTICRITERL^ 
CASE WITH BINARY VARIABLES 


The vector maximization problem in 0,1 variables as sta- 
ted in the first chapter, can be written in the following form 

N 

(P) V. max. c^ X. 

j=l ^ 

N 

s.t. a^ x^ ^ b 

j=l 

1 s X . s 0 INTEGER 
J 

Our goal is to find the set of efficient points of pro- 
blem (P) . The approach that we will describe is an applia- 
tion of the implicit enumeration algorithm, already analyzed 
for a single objective in the last chapter, but before begin- 
ning this sttidy, let us consider again the auxiliary problem 
(the unit hypercube) in an attempt to obtain all the possible 
efficient points . 
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3.1 The Auxiliary Problem 

The problem of the unit hypercube can be stated as fol- 
lows 


(P') V. max. c“^ X. 

j=i J 
1 s Xj ^ 0 INTEGER 

If we find all the efficient points in the unit hyper- 
cube (?’), we will find a set EF (A) , v;hich can be subdivided 
into two different sets by only testing feasibility in our 
original problem (P) 

LB (A) FEASIBLE S IN (P) 

EF(A) 

U3(A) INFEASIBLES IN (P) 

We call those sets (A) , because they belong to the AU- 
XILIAB.Y problem (unit hypercube ?'), 

The set SF (A) is the set of all efficient points of the 
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auxiliary problem. The set LB (A) consists of those efficient 
points that are feasible in our original problem (P) and 
therefore are also efficient in it. They will form an ini- 
tial lower bound set (LB) that afterwards we will be able to 
use in the implicit enumeration method. The set UB(A) con- 
sists of those efficient points that are not feasible in our 
problem (P) and therefore will dominate the rest of the ef- 
ficient solutions that we need to find. They will form an 
upper bound (UB) set v/hich dominates all the efficient points 
not included in the LB (.A.) set. 

If we could find the directly dominated points of each 
element of the UB(A) set, we would get the following kinds of 
points : 

-Points dominated by the LB (A) set. We discard them. 

-Points not dominated by the L3(A) set. We test feasi- 
bility in (?) . 

-Points feasible in (P) . They may or may not be 
efficient, but we include them in the LB (A) set. I'Jhen no in- 
feasible points remain we test dominance betw’een the elements 
of this set and obtain the final set of efficient points of 
(?). 
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-Points infeasible in (?) . In order to find their 
dominated points, we have to repeat the process. Eventually 
we reach a moment in which no infeasible points remain. 

Tv 70 problems need to be solved for this approach: 

-Find all the efficient points in the unit hypercube (?') 
or EF(A) . 

-Find a method to locate all the dominated points of a 
certain element of the set UB(A). 

Solving these two problems w’ill require as we have seen 
in Bitran's paper, a lot of computations, but we can still 
use these concepts to start the second approach with good lo- 
wer bounds that can improve substantially the fathoming step. 


3.1.1 Finding Efficient Points over the Unit Hypercube 

If all the objective functions contain all the variables 
then, we can find at most, p efficient points, by only maxi- 
mizing each of the p objective functions. 

In this maximization we only need to take a variable to 
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be either 0 or 1 depending upon the sign of its coefficient. 
For each objective, we set to 1 if ^ ® 

c.. <0. In this case v/e find between 1 and p efficient points 
depending upon the coefficients of every objective function. 

If some of the objective functions contain only some of 
the variables, then, in general we can find more than p ef- 
ficient points . This is because when we have to maximize a 
function of less than n variables we will have some unfixed 
variables. In order to fix the remaining variables we simply 
find another objective function that contains those variables 
and maximize it. We continue this procedure until we have 
fixed all variables. It is clear that depending upon the ob- 
jective function selected we can find different efficient 
points, so we must check all possible combinations and, fi- 
nally test dominance among all the points found. 

This may be accomplished in the following way; We know 
that the variables fixed at 0 or 1 in the maximization of a 
particular objective are not going to change their status. 
Therefore, we have to worry about the remaining variables. 

To do this, we check the coefficients of a particular not 
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fixed variable, over all the objective functions and come up 
with three different cases: 

-If all the coefficients are positive, then we only need 
to set this variable to 1. 

-If all the coefficients are negative, then by the same 
token, we will set this variable to 0. 

-If the coefficients are positive and negative, then we 
need to set the variable to 0 and 1. 

After doing this for every non-fixed variable, and maxi- 
mizing each one of the objective functions v;e will obtain a 
set of vectors whose components are zeros and ones v;ith the 
peculiarity that among its members we have all the efficient 
points of problem (?'). 

To find all the efficient solutions we have to do just 
two more things : 

-First, eliminate all the vectors that have the same 
components, because probably some vectors will be repeated. 

-Second, find the values of each of these vectors in the 
multicriteria space and test dominance among them via pair- 
wise comparisons. 
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The result will be all the efficient points in the unit 
hypercube. It is interesting to note that the value in the 
multicriteria space of a specific objective function will va- 
ry between a certain upper value found by the maximization of 
this particular objective function and a lower bound that 
will be the minimum value that takes the same objective a- 
mong the rest of the maximizations. 

That is to say, for a particular objective k, this value 
in the criteria space will vary between the value of the max- 
imization of k and the minimum of all the maximizations of i, 
i k, i = l,...,p. 

Having found EF(A), we will see how in the next approach 
(the implicit enumeration algorithm) we can use the two sets 
LB(A) and UB(A) for fathoming purposes, . 

3 . 2 An Implicit Enumeration Algorithm 

As we have seen in the last chapter the implicit enume- 
ration algorithm is based on a number of concepts that nov7 
will be analyzed for the multiobjective case. 
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The algorithm is basically the same as in a single ob- 
jective problem. The separation at stage k is determined by 
choosing a particular variable not selected previously a- 
long the path from v^ to v^. The path corresponds to 
an assignment of binary values to a subset of the variables. 


If we denote the set of assigned variables as and 

we let: 

: ( j : j e % and x ^ = 1 ) 

: ( j : j £ \ and x^= 0 ) 

Fu : ( j : j i\ ) 

Then we can consider the problem at stage k 
(MP) Ma:^ 2, = 

s . t . 


H C j K . + U c-^ 

j€F,^ J j^S+ 

^ rs. 

X] a"^ X, s b - S a'^= 






In the development of the algorithm, we need to analyze 
a number of concepts such as Bounding, Fathoming, Branching, 
etc. which shall now be considered. 
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3.2.1 Bounding Procedures 


There are two kinds of bounds that we must analyze; 

LOI-TER. and UPPER, bounds, and the first thing that we need to 
do is clearly define both of them. 

LOWER BOUND SET: Each element is either efficient or is 

dominated by at least one efficient solution of the problem. 

UPPER BOUND SET: Each efficient solution of the problem 

is dominated by at least one member of the set. 

Next, let us discuss the various ways that these bounds 
may be found. 

LB. LOWER BOUNDS . 

LBl THE AUXILIARY PROBLEM . 

A first set of lower bounds can be found in the auxili- 
ary problem (P') as we have seen in section 3.1. Finding the 
set of efficient points in the unit hypercube EF (A) we can 
obtain a first set of lower bounds by testing feasibility in 
problem (P) . 
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The set of points of EF(A) which are feasible in (P) , 


will form a lower bound set LB (A) of (P) . 


L32 X's METHOD 

By solving the next problem find another 

set of lower bounds: 


f^(x) 

a-^ X ^ b 

j 

1 s X . ^ 0 INTEGER 

j 

N 

where f . (x) - C.. x 

^ j=l J 




Max 


P 

E 

i=l 

P 

s.t. E 


Any set of positives values of will give us a lower 
bound that some times may be an efficient solution to our 
problem. The number of points to generate will depend on the 
computational advantages achieved by using the extra points. 


LB3 HEURISTICS 

Another set of lower bounds could be obtained by compu- 
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ting feasible solutions to the (P^) problem just described. 
These feasible solutions may be found using heuristics such 
as those described in Toyoda [43], and Loulou and Michaelides 
[36]. 


LB4 EFFICIENT SOLUTIONS 

In general, we must not forget that any solution to the 
original problem which is efficient in (P) , is a good lower 
bound for the problem. Therefore, in this procedure, when we 
find another efficient solution to the problem, v/e can add it 
to the lower bound set. 


UB UPPER BOUNDS 


Different sets of Upper Bounds may be formed by the fol- 
lowing methods : 

UBl 

Obtain the solution to p different problems of the fol- 
lowing form, where the objective function is one of the p 
original objectives of (P) . 
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Max 


C . . X. 

J 




s . t . 


E 


j 


a 


X :S 

j 


S 


1 ^ X ^ 0 INTEGER 

j 


We will form a vector whose position or component 
corresponds to the value of the soution to the problem with 
the i^* objective function. UB(F) . This procedure has to be 
executed for each stage of the problem, and since this upper 
bound is done only for the free variables, we have to add it, 
component by component to the value of 2 at this stage k. 

So, the value of the upper bound of problem (P) , 2 ^^, at stage 
k, is 

z, = z © UB(F) 

k k 


U32 

Simpler sets of upper bounds con be obtained by relaxing 
the problem as follows: 


Max 



C X 

ij j 


j 
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INTEGER 


s . t . 



If we divide the free variables set at stage k, into 

two sets, for each objective function p, we can find: 




j : j e F and C . . ^ 0, Vi 


j : j e F and C ^ 0 . Vi 
kr ij 


Then the upper bound set U3(F) in this case, is very sim- 
ple to find: Ue set x to 1 if j eF^., and to 0 if j £ F, . , 

j ki ■' ki 

for each objective function. 


Then, the upper bound set of our problem (?) will be 


z^= Q UB(F) = 




3 £ S 




E 




r — l,...,p 


I'Jliere z^ is the solution of the problem at stage k, amd 
UB(F) is the upper bound of the residual problem at stage k. 


UBS 


Another way to find an upper bound set is by solving p 
problems of the form: 
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Max 

s . t . 


where the constraint set inforced is any one of the constraints 
of the original set. The bounding procedure would then require 
the solution of a serie of different Knapsack problems . 

UB4 DUAL PROBLEM 

From the solution of the dual problem associated with 
the linear relaxation of (P) 


C . . X, 

X] A. . X, ^ s . 


1 s X s 0 INTEGER 

j 


(D) 


Min -{ e w + s 




s.t. wI+uA^C, 

X 

w,u ^0 


where corresponds to the i^'"^ objective function, w and u 
are dual variables associated with the upper bound and re- 
source constraint A respectively, and e^ is the row vector of 
I's. 
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The solution to this problem obviously exists, since 
s s 0 and it is attained at one of the extreme points of the 
set of solutions. 

Let the set of extreme points for a given objective 
function C., be denoted by . Then the i^ component of the 

X ^ 

Ic 

upper bound vector UB(F) at stage k, to be denoted by UB^(F) 
is given by 

UB^(F) = Min | e^ w° + s^ u° 

For this relationship we have 

e*^ w° + s^ u° ^ UB^ (F) 

Then, any basic feasible dual solution can be used as an up- . 
per bound for the particular objective function value at 
stage k. 

UBS 

Other upper bound sets can be found by relaxing the cons- 
traints of problem (?) and keeping the integrality constraints, 
or viceversa, by relaxing the integrality constraints. 
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w° , u° e n . 

1 



v-max 


(P ) 

ra 


X!/ c-^ X 


s . t . 


S a. .X ^ s 
jeF, ‘J J i 


1 ^ X $. 0 INTEGER 

j 


and (Pj.^) 


v-raax 


Z 


X 




s . t , 


E 


j^F, 


a X. ^ s 
J 


k 


l>x.> 0 
3 


UB6 LAGRANGIAM RELAXATION 

x^nother upper bound vector can be found through a La- 
grangian relaxation, by solving the following problem at 
stage k. 




Max 


C^x - X(Ax - s) 


s . t . 1 >: X 5: 0 INTEGER 


where denotes the lagrangian multipliers and 


E 


J 

CL 


X. 

J 


Ax represents 
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The associated dual problem is 


(D;^) Min I Max { (C^ - XA)x + Xs } | 

s.t. l^x^O INTEGER 

X 

We know by duality that i^(D ) ^y(P), being i/(.) the so- 
lution value of problem (.)• R.earranging the Dual, x^re arrive 

at : 


(Dx) 

Min 

1 X s + Max 

(C. + XA); 


s.t. 

1 >:x ^ 0 

INTEGER 


Geoffrion [22] , Glover [2S] and Greenberg and Pierskalla 
[ 30 ] have developed results that imply 

y (P) 

xjhere P is the linear relaxation of problem (P) . Geoffrion 
also suggests that p(P) = in the case in which the 

problem (P^) possesses the follox-zing property: 

INTEGRALITY PROPERTY: Problem (Px) » has the integrality 
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property, if ~ ^ • 

In our case, it is clear that (P;^) has the integrality 
property. So, we only need to solve p linear relaxations of (P) . 

UB7 SURPvOGATS RELAXATION 

The surrogate relaxation for problem (P) , will be 

(Ppi) Max C^x 

s.t. M(Ax - s) ^ 0 ; 

1 ^ X 0 lOTEGEP. 

The associated surrogate dual problem is given as 

; M $0 

Geoffrion also suggests that 

(P) $ ^ ^ 

As mentioned earlier, v(P) = 'J (P\) in our case. So, 
using the value of the surrogate dual for each objective 
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function, will give us another upper bound vector of our pro- 
blem. 


U38 

Finally, another set of upper bounds is obtained from 
the unit hypercube. Althoug this UB(A) as we have seen is not 
like the others already analyzed, an upper bound of the FREE 
variables . but rather of the entire problem, it will be used 
in a slightly different v;ay in the following study of fatho- 
ming . 


3.2.2 Fathoming Criteria 

The fathoming criteria that we will study in this section 
are based fundamentally on the feasibility tests and on the 
bounding procedures already analyzed. The different tests 
that we will perform are essentially the same as those studied 
in the case of a single objective function: Fathoming by FEA- 

SIBILITY and fathoming by BOUNDS. 


71 



FI FATHOMING BY FEASIBILITY 


We say that a point is fathomed by feasibility when at 
a given stage of the algorithm, one of more constraints are 
not satisfied. We know that the matrix of constraints at 
stage k is given by 


E 


a X 

ij 2 


r~~l, • . • , m 


In order to provide a better way of expressing the idea, 
we will divide the set of free variables at stage k, F, , into 
two sets: For each constraint i, we will have 



for i=l , . . ,m 



Thus, for each constraint i, 'vve can define t. as follows. 

1 

First, set x. at 0, if 1 £ F, . , and at 1, if i eF~ . Let 
j ' kx’ kx 



rw jL. 
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It is clear that the fathonins by feasibility will take 
place in the moment that at least one constraint satisfies 
the inequality this case, we can delete the point 

from further consideration. 


F2 FATHOMING BY BOUNDS 

Two kinds of fathoming by bounds need to be considered: 
F2.A 

VJhen at a given stage k of the problem, the vector of 
upper bounds of the objective functions z, is less than or 
equal to any lower bound vector L3^ of the set of lower bounds 
LB of our original problem, we can also delete the point. 


The upper bound vector z^ is equal to 


z, = z, © UB(F) ^ LB 
K k 1 


The value of the objective functions plus the upper bound 
vector on the free variable. 


F2.B 

Another fathoming case is when at stage k, the vector 
value of the objective functions z, , cannot be dominated by 
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any of the vectors of the upper bound set of the auxiliary 
problem UB(A) , since we know that the rest of efficient points 
that we need to find must be in the set of points dominated 
by UB(A) . 


To achieve this, we have to find the best case in which 
Zy^ can appear. Therefore, we will form a lower bound of Zj. 
at stage k, Zy^, by adding, to the value of z^., a lower bound 
vector on the free variables. This lower bound of the objec- 
tive functions can be found as follox^’s : Having defined F, . 

and F, . for i=l,...,p on page 72, we set a free variable to 
0 or 1 depending upon the sign of the objective function co- 
efficient. We set X. at 0 if j £ F^ , and at 1 if j e F, . . 

J ki ki 


Therefore 






j 

c 


and then, we can fathom the point if the value at stage k 
not dominated by any element of the set UB(A). 
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That is to say, in order to be able to fathom the point, 
the relationship (UB(A) UB(A) greater than or equal to 

with at least one strict inequality, cannot be verified 
by any of the vectors of the set UB(A). 

This means that at least one component of ^ is greater 
than its respective one in the vector UB^(A), for all vectors 
in the set UB(A), although it is not necessary that it be 
the same component. 


3.2.3 Bounding on Variables 

As we have seen in the last chapter, the solution time 
increases exponentially with the number of variables. This 
can be a reason why the Zionts test for finding upper and 
lower bounds in variables has such great computational advan- 
tages . 

In fact , we think that any branching rule taking into 
account feasibility, will lead us to choose the same variable 
as in Ziont's test, but the advantage of one in respect to 
the other is clear. Ziont’s test will tell us, a priori > 
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V7hich variable or variables have to be set to a specific va- 
lue. Instead, the branching rule will recoinmend us to take 
this, variable to the same value; aftenizards, xchen we check 
the other branch of the tree, where this variable takes the 
alternative value, we will find that this branch is infea- 
sible. The problem will be to know if the computational time 
spent in the branching is bigger than the one spent in find- 
ing the different bounds . ’ 


We will now try to find which variables must be treated 
for bounds. To do this, we begin by dividing the set of con- 
straints in two sets; 


Q,“ = i : 3? < 0 
k X 


qt = i : s^ < 0 

^k X • 


and the set of variables for a particular constraint i, in 


R- = i : aij < 0 


1 


i : a. .>0 
^2 


We begin by analyzing the variables in the constx*aints 



BVl For the variables in the sets and Rj;. 
A. Lower bounds: , 


= Max I 0, (b./a.j)+a/ay)( E aTj^ + | 


>0 


h'/'j 

<0 


wh^ra = Max ( 0, b^- ) is always equal 0. 

k=^ j 

So, we want (b . + aT, )/a.. >0, in order to be able 
r , , . ik X J 

k*j 

to have hj greater than 0. 


A way to find which variable to test is the following: 

R.eindex constraint i so that the coefficients a, . be in non 

ij 

decreasing order. We can define 


T^(q) = E a 

j*q 


and find T.(q) for each variable q e R,. beginning for the v 


ri 


able q = Max a. . . 


j E R. 


- iJ 


We will find p such that F^(p) <lbj^ T^(p+1). Thus 
we have to test the lower bound for all variables between q 



B. Upper Bounds. 


u, = j (b,/a. 


)-(X/a )( 

>0 <0 


S a"!" + 

ik 


“n+i> I 


>0 


Then, is always greater than 0, for all j £ and we 
will show that it has to be greater than 1. Since 


Since, u , , = b. + 2 ^ a , , then, u. will be 

1 k+j ^ 

u = -( S al" + S a~ )/a.. 1 

J k=f=j k=f=j 

always greater than one, because X/ aT, >-a... Thus, do 

k-+j "-J 

not have to find any upper bound of any variable of R.j^. 


BV2. For the variables in the sets Qi^ and Pv^ 
A. Lower Bounds. 


h , = Max 
J 


{ <V^3>- 


(1/a. 


.) 23 a+ 


<0 


k^j 

>0 


-f u I 
ik n+i I 


v;here u , . = b. + 23 

X xk 


a . Thus, h. is always less than 0, 
k+j J 


and therefore we do not need to find any lower bound for any 
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variable in R^. 

k 


B. Upper Bounds. 


u.= {(b,/a,.) + a/a,.)( E + } 


<0 


>0 


kM=j 

>0 


=0 


We can distinguish several cases: 


-If 

Ib.l 

>E 

k+j 

^ik 

-If 

lb,l 

E 

^ik 


k+j 


-If 

Ib.l 

1 

< 23 

^ik 




all negatives variables have to be s 
set to one and all positives to zero, 


It is clear, that we do not need to find u. in the first 

J 

two cases. However, we do need to find it in the third case, 

but only for one variable, variable p = Wax a,- a , and set x 

at zero if u < 1 . 

P 


This is clear, because we v/ant the upper bound as 

low as possible. So, we want a^^ as big as possible because 

b. + a., is fixed. 

1 I . . IX 

k+j 


79 



We can easily see that if for p, Up>l, it is because 


aT, >a. . For any other variable 1 such that a. i<a- 
i . . ik xo xj 1 


k#j 


ip 


is clear that also b 


i > ^ij ■ 


k=f=j 


If for variable p, u <1, it can also work for another 

P 

variable j with a. . < a. . We can then find the u. for the 

ij ip J 

next variable q, such that 


q = Max 


an continue 


finding u^ 



until 


j+p; 

the first ^ ^ f is 


found. 


BV3 For the variables in the sets Q^. and R,~ 
A. Lower Bounds. 


h. 

J 


Max I 0, (b^ 


/ai.) + (l/a. .) ( aT, + h 


<0 


<0 


n+i^ j 


>0 


where is equal zero in this case. As we can easily see, 
h^ is always negative. So, v;e don't need to find it for any 
variable in rT. 


B. Upper Bounds. 
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)-a/a,,)( 

k=i=j 


E a'!'. + u ,.) ] 

k*i I 


<0 <0 


>0 


where +. Xy is clear, that we do not need 


k+j 


to find u. in this case, because 
J 


u = -( 2 a’ + 2 

^ k+j k4=j 


The only case that we have to study is when 


b. 

1 


< E at, ^ E 

k=^j k+j 



because when this inequality is not satisfied, the problem 
is always feasible. 


I 4- 

BV4 For the variables in the sets Q, and R. . 
k K 

A. Lower Bounds. 



>0 >0 >0 


In this case, we do not need to perform this test because 


SI 



always less than zero. 


h. = -( 2 a., + 2 at )/a.., 

J k+j '■J 


E. Upper Bounds. 


u .= < (b . /a. . 
J (1 3.J 


) + (1/a..) 


ij 


>0 


>0 


y : 


+j 

>0 


ik 


As we can see, always greater than 0. And given 

that b.+ a7, , is always positive, we want a.^ as big as 

1 1 • 1*^ 

possible. So, we will find u. only for p = Max a-i 


If ^p>l. it will be also for any other variable q such 

that a. <a. . If u<l, it could be also true for another 
iq ip p 

variable i v/ith a.. <a. . We can then find the u. for the 

xj ^ IP • j 

next variable q, such that 


q = Max a ; j=J=p; j eR 


+ 


and continue finding u- until the first u.>l, is found, 

J J 


A simpler wa}’- to do this test, is to avoid this last pai 
and find u^ only for p, because the same procedure will come 
back to the same row at the next iteration and it v/ill cal- 
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culate u, for the new p, which is nothing more than q. 


3V5 A simplification for sections BVl.A and BV3.A 
A simpler test is the following: Instead of finding 
Tji^(q) and testing the lower bound for all variables between 
q and p, we could do a simpler test only for variable q. 


q 


1 


Max a. . 


^2 “ 


Max 

je4 


a. . 


in each case. 


For section BVl.A, test only for q^^. 

we know that not only hq<0, but also that 
j such that a^j < a^_p will have 


If 

any 



other variable 




> 




> lb. I 

1 


so, any other j will also have 


h. < 
J 


0 . 


For section BV3.A, test only for q 2 if 



> 



A further simplification can be to test for only soma 
constraints. Lemke and Spielberg [35] , tested for only one, 
the one with less entries, because this one, is the more li- 
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kely to have a lower bound greater than 0. We could find a 
set of constraints which contains the greatest number of po- 
sitive (negative) coefficients. 


We can construct a similar procedure for our case, and 
find the constraint with the smallest number of negative vari- 
ables (positive) , if we are in Q," (Q^) . 


To do this we can simply find the constraint with the 
highest index J. 

# of total elements in row i 

j7 = — for 

if: of negative variables in row i 

ir of total elements in row i 
J+ = for Q+ 

# of positive variables in row i 


We have found, then, tV7o constraints, in v/hich we will 
perform tests 1 and 2 , respectively. (See Summary) . 


This is not as simple as 
tests 1 , we can see that: 

-In test 1.1. A, in order 


it might seem. If we analy^e 


to have h as big as possible, 


S4 



BOUNDING ON VARIABLES 


SLEC^ARY 


A. LOL^R BOUNDS B. UPPER BOUNDS 




1.1 R- 


1.2 



2.1 R 


k 



FIND h : o=Max la. .1 

TT^TT _ 

Z a- <|s^| 
J"P 

NO 

NO 

FIND u_ : D=ilax, a. - 
? ■ 

iff ^ 

^Ik 

IF 

ls^I>S aij^: INFEASIBLE 
k^j 

i- 

IsJI =Z^ a7, : SET ALL 

k+j VARIABLES ; 

NEGATIVES AT ONE, AND 
POSITIVES AT ZERO. 

NO 

IFlsV'I^X/ a"!", + ^2 a 
^ 1 . . ik , , . ik 

k=f=j ktj 

ALV7AYS FEASIBLE. 

NO 

FIND u : p=Max a. . 
P jeR:" 

iC 








we want the fewest negative variables possible. 

“In test 1.2.B, in order to have u as low as possible, 

P 


we want 


E 

k*j 


a,, as little as possible, 
ik 


Analyzing tests 2 , we can see that in test 2. 2. A we 

X7ill need the fewest positive variables possible, because X7e 


x^ant a. as little as possible. To the contrary, in 




. ik 


E a- 


test 2.2.B, we x/ant Z_/ a. as small as possible, 

k+j 


Finally , we present a summary of four possible x^ays of 
determining bounds on variables, as x^ell as their correspon- 
ding block diagrams: 


“Diagram nximber one is a procedure to find all the vari- 
ables that have to be set to 0 and 1 by bounding in variables 
We analyze every constraint and each time that x-.^e set a vari- 
able, we change RHS's and begin the problem again, 

-Diagram number two is the same as number one, except 
that we x<7ill look at all the constraints and set all the vari 
ables to their respective values without changing RK3 ' s . At 
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the end, we must verify if these are contradictory. In this 
case we say that the problem is infeasible. 

-Figure number five shows the same procedure as before, 
but only taking into account one constraint, the one most li- 
kely of being infeasible, measured by the method discussed in 
Chapter 3. This method is also fathomed by feasibility since 
it is easy to prove that if the selected constraint is fea- 
sible, no constraint can be infeasible. 

-Figure number sdLx is a simpler procedure to find only 
some of all the possible variables that have to be set by 
bounding. The only difference is that we just test the lower 
bound for the most negative variable in each constraint. This 
was coded in fortran IV and put in the main program as subrou- 
tine "Feasibility", because as we can see in the flow chart, 
at the same time that we are setting variables by bounding, 
we can fathom when the RHS is negative (testing feasibility) . 


3.2.4 Branching Rules 

One of the most controversial aspects of any algorithm 
based on an implicit enumeration scheme is the branching rule. 
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FIGURE 6. 

FLOW CHART #4 
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For our purposes, we will distinguish between some very 
clearly defined approaches. Ue consider that in general, the 
goal of any branching rule most be to arrive sooner at an op- 
timal solution if one exists. In particular, v;e will want to 
arrive as soon as possible at a point in which the different 
fathoming criteria already analyzed are more effective. One 
of these approaches can be based on the study of the objec- 
tive function matrix, while another possibility is to consi- 
der the constraint matrix and the concepts of feasibility and 
infeasibility. A third approach will be obtained by taking 
into account the bounding on variables described in the last 
section . 

3R1 THE OBJECTIVE FUNCTION APPROACH 

One way to branch is looking at our goal of arriving as 
soon as possible at a point where the fathoming by BOUNDS will 
be effective. 


Considering that the objective function matrix has in 
general, positive and negative coefficients, c^j , we can try 
to see which branching rule will improve the fathoming by 
EOUl'JDS that we have already discussed in the preceding section. 



As we have seen, we have two kinds of fathoming by 


bounds : 


FI 


F2 





SmmJ qJ < LB 




+ 


9 TJB(A) 


T'Jhere 9 means that at least one component has to be greater 
for every vector of UB(A). 


Then, if we are at stage k of the problem and we are fea- 
sible and unbounded, we are in a stage in which the opposite 
relationship to FI and F2 are satisfied. Now, we can try to 
see v;hich variable to set and to x>;hat value, in order that 
each bounding procedure be more efficient at stage k + 1. It 
is clear that what we will need is that z. , , be as low as 
possible and large as possible. 


To achieve this x^e can analyze what variable v;e need to 
set to 0 or 1 for each of the two cases . 


FI . At stage k, we have that 
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. . s. 

k . ^ „-r 



C*^ + ^ lb 

j E s- j e 


K 


and at stage k+1, we would like that 


'k+1 


. E 

j e s 


cJ + 


k+1 


Z 

j e F, 


c < LB 


k+1, i 


IC 


,+ 

'k+1 


It is clear that in order to get we need to 

decrease all components of that are greater than its co] 

responding ones in LB. Let's study one of those components 
at stage k. 


c . . > 0 
i-J 


X . 


X , 


K' = K 


^k+i < '^k 


K'= K + c. . 

F*^ < F+ 

k+1 k 


^k+1 < “k 


^k+1 - -k 


c <0 

ij 


X: 


X 


IV = K 


^k+1 


K'= K - 


,7+ 

n-. 


"iJ 


'k+1 


= F 


+ 
k / 


’k+1 ^k 


^k+1 < 


94 



As we can see in the last table, for an objective i and 
a variable i , if c..>0 we set x. -+ 0, and if c.- ^ < 0 ^e. 
set Xj -♦ 1, because what we need is 

So far we know that a variable with a specific value has 
to be set to a determined value. But in general, for a par- 
ticular variable x., we have c,* ^ >0 and c.,<0 for differ- 
ent objective functions i and what we need is to decrease all 
the components of that are greater than its corresponding 
one in LB, To decide what variable has to be set to one or 
zero, we need to define an overall coefficient for each va- 
riable j, at stage k, that gives us a measure of the sign of 
the coefficient of this variable, for all the objectives at 
the same time. 

This overall coefficient, defined over all the objectives 
could be the following vector 0(K) of dimension n-k and whose 
component j will correspond to a variable j at stage k, such 
that 

P 

0 . (k) = 12 c . . for all j £ F, 

3 ij k 
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Then, we can easily find Xi/hich variable has to be chosen 


for branching. We choose a variable p such that 


Op(k) 


= Max 0 . (k) 

j ^ 


and take x -♦ 0 ; if 0 (k) > 0 . 

P ? 

We can find also another variable q such that 


0 (k) = Min 0 ; (k) 

^ j C F, ^ 

k 


and take 


X 1 ; if 0 (k) < 0 
q P 


F2 . At stage k we have 


^k = 





jest 


« c^ ^ UB(A) 
j ^ ^ki 


K 


f; 


K 


and at stage k+1, 'we would like that 


^k+1 “ 




cJ + (3 UB(A) 


J ^ ^k+1 j ^ ^k+1 , i 


V > 


k+1 
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That is to say, at least one component of is bigger 

than its corresponding in one of the vectors of UB(A) . For 
all vectors of UB(A) and not necessarily the same component. 
Even though we only need one component, it is probably that 
not the same component will satisfy this requirement for every 
vector of U3(A) . 


It is clear then, that in order to get ® UB(A) 

what we need is 


Ci- >0 


X . 

2 


X . 

J 




^k+1 " 


K + c. . 
^k-fl = 


q<+l -k 


S.k+1 > ^k 


c . . <0 


X. -♦ 0 

2 


' X -♦ 1 

j 


K' = K 




K'= K - c. . 

J-J 

^k+1 > 


fy rr 

-k+1 > ^ 


2. .1 Ci Z, 

— k+1 — k 


As we can see in this figure for an objective i and 


variable j, if c_ >0, we set x^ at 1, and if c^j <0, at 0 
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Therefore, we should not put together both types of fa- 
thoming by bounds because as Xve have seen, a branching rule 
that increases the potential of the fathoming is contradic- 
tory to both of them. 

BR2 THE CONSTPAI^]T MATRIX APPROACH 

Another way to branch is by taking into account the 
constraint matrix. Our objective in this case is to arrive 
as soon as possible at a point where the fathoming by feasi- 
bility is more effective. 

F 

= ,f^. ^ 

ki 

Considering that the constraint matrix has in general, 
Dositive and negative coefficients a. . , we can try to deter- 
mine which branching rule will improve the fathoming by fea- 
sibility that we have already discussed in the preceding sec 

tion. It is clear, that if we are at stage k of the problem 

k k 

we have a situation such that t. < s.. Then, what we need 

at stage k+1 is, if possible, that tV"^^> In order to 

^ i 
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, . , . j . k+1 k+1 k+1 k 

achieve this , we need t. >s, ors, ^s., 

1 1 1 > 1 


As we can see in the next table, for a constraint i and 
a variable j, if a..>0, we set x. at 1, and if a. .< 0, at 0. 


3-J 






a . . 0 



t 

1 

s . 
1 

Xj-O 

II 

— ‘r-l 

w 

1 

sl= S. 

X. -1 
J 


®i= "i- . 

X . 0 

J 

t!>ti 

s!= Si 

X. -♦ 1 
J 

. tl>ti 

s I = s .+ a . . 

^ 3. ij J 


The problem in this case is to answer the following two 
questions : 

-Do we have to consider overall coefficients or shall we 
look at individual rows? 

-Do we need to look only at coefficients or shall we in- 
troduce the PJ-IS ' s in our consideration? 


We will discuss these questions after analyzing the fol- 
lowing branching rule. 
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BR3 THE BOUNDING IN VARIABLES APPROACH 


Another way to branch is by considering the bounding in 
variables, since we know that this feature decreases the com- 
putational time substantially. 


As we have seen, there is a fundamental difference be- 
tween constraints with RHS's positive and negative. If the 
RHS is negative, \<:e can carry the problem to a point xvhere it 
is infeasible, when 


lb I > Z) a“ 

^ k=*=j 

Besides, in this case, we can find two variables with a pos- 
sibility of being bounded. One negative of the lower bound 
is greater than zero, and another positive with the upper 
bound less than one. 


If the RHS is positive, in order to be able to say that 
the problem is infeasible we have to drive the RHS to a nega- 
tive value. Besides, we have the possibility that for a con- 
straint the problem is always feasible, when 


b. 

1 





ik 
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In this case, we can only find one variable with the 


.possibility of being bounded, a positive variable when the 
upper bound is less than one. 


This third approach is essentially similar to the second 
one, but with the particularity that now we can answer one 
of the questions previously raised. Since only one single 
infeasible row is enough to make the whole problem infeasible, 
we do not need to find overall coefficients. We will then 
examine only single rows of the constraint matrix and in par- 
ticular those with negative P.HS. In this case, if at stage 
k the problem is feasible, for a negative constraint we have: 



Qi 


J € ? 


ki 


and even more, if no variables have been bounded, we knov; that 


Z 


a. Is^^i : q 


Max 




Our purpose is to drive the problem towards points at 
which the bounding on variables is more effective and, if it is 
possible towards infeasibility. 



To accomplish this situation requires that at stage K+1 


a". 4 < Z-/ aT . 
- , i j • 1.1 

j:#=q J=#=q 


E 

i*<i 

kx 


or 


Is^l > Is^^M 


j€F. 


k+1 , i 


As we can see in the next table, the solution is the 
same as in BR.2, but now we have a very good idea of how to 
branch. If we have some constraints with negative RHS’s, we 
can choose: If a.- 4 > 0 , set x, at 1, and if a,.<0, at 0 . 


ij 




c . . > 0 


c. . < 0 


X. -+0 
J 


x.-l 

J 


X. 0 
J 




r 


E a:. 
i 


EQUAL 

EQUAL 


1 


for i € Qj: 


k 
s . 

T 


EQUAL 

t 

EQUAL 


Instead, for constraints with positive RHS's, (in the 
event that we do not have any with a negative RHS) , our goal 
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is to drive the constraint towards negative PJIS's, in which 
case the best way to branch is: If > 0, set at one. 

Still, we need to know which row to choose. The proce- 
dure that v;e suggest is the following: 

-If we have some rows with negative RHS ' s v;e will choose 
among them: 


1 = Min (s^+ Xya..); q = Max la. .1 

i^Qj; " j^R- 

For the case in which we do not have any negative P.HS 
row, we will choose the follov/ing one: 

1 = Min, ( - X) aT.- X at.); p 

j^q ^ j-P ^ 

BR4 THE FEASIBILITY APPROACH 

Another method is the traditional branching towards fea- 
sibility. As Geoff rion suggests, branching towards feasibi- 
lity has the advantage that we will arrive sooner at a pos- 
sible efficient point and therefore we can increase our lower 


Max , a . . 
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bound set. 


Branching towards feasibility requires the use of over- 
all coefficients. Garfinkel and ITemhauser [IS] suggest a way 
to find which variables to choose. 

m 

I, = l-a:c (0,-s.) = - ^Lj s. 

i=l ^ ^ 

is the overall infeasibility at stage k. Ue can find the in- 
feasibility that at stage k+1, the branching in variable j 
will produce; 

m 

( j ) = 2-^ Max (0,-s j ) 
i“l 

and then we will choose variable 1 such that 


1^(1) = Min I^(j) 


D 


R5 


Finally, we can use a combination of branching rules as 
suggested in Breu and Burdet [ll] . 


104 



A combination of the BPv.1 and BR4 criteria will be 


XI (k) (1-X) 0^(k) 

p p 

where for X=1 is absolute feasibility branching and for X=0 
is absolute objective branching. 


3.2.5 Dominance Test. 

Testing dominance is not so simple if we want to do it 
in the fastest possible way. We have already seen in Villa- 
rreal's work that the dominance test is one of the most time 
consuming . 

In order to better develop the explanation of the dif- 
ferent ways to perform this test we distinguish two different 
kinds of dominance tests: 

-DIPvECT DOMINANCE. Once we have found an end point in 
the implicit enumeration algorithm (we will call this point 
"feasible", that is to say that it is not fathomed either by 
the feasibility test or by bounding) we test if this point 
is dominated by any of the vectors already on the list. 
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-INVERSE DOMINANCE. On the other hand, we can also test 
if this point which we have found, dominates any of the points 
already on the list. 

Having clarified this concept, we will analyze the dif- 
ferent strategies . 

DTI 

One of the most complete dominance tests that we can per- 
form is the following: We begin by determining for each fea- 

sible point found, the variable SC, the sum of its p components. 

If EF(i,j) is the matrix of all the points that are in- 
cluded in the list, 

P 

SC(j) = EF(i, i) for each j. 

i=l 

Since we know that if we have two feasibles points k,l, 
and SC(k)> SC(1), the vector 1 can not dominate vector k, we 
can proceed as follows: 

We form the matrix EF(i,j) by ordering all vectors j from 
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the largest to the smallest in terras of SC. Then, each time 
we find a new feasible point m, we determine its SC(m) and we 
put it in its correct place (m) in the matrix. Then, we only 
have to test dominance in the following way: 

-We test direct dominance from the first vector in the 
list (greatest SC) until the vector in the place m-1, (which 
are the only ones that can dominate vector m) . It is under- 
stood that if one of these dominates point m, we do not need 
to continue the test, and vector ra may be deleted. 

-If point m in not eliminated, then we teat inverse do- 
minance from the vector in place until the end. These are the 
only ones that can be dominated by vector m. We delete all 
points dominated by m. 

The problem at this point is to know if the time gained 
with the procedure compensates the time spent in ordering 
matrix EF. 

DT2 

The simplest way to perform this test and find all the 
efficient points of the problem is simply to introduce all 
the feasible points in the matrix EF and at the end of the 
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algorithm perform direct and inverse dominance, or use the 
algorithm in Bitran [lO] . 

We begin by comparing the first element of EF with each 
vector on the list, performing first direct dominance and 
afterwards inverse dominance each time. All the points do- 
minated by the first vector are deleted without testing in- 
verse dominance, and in the moment that a point dominates the 
first element it is automatically put in the place of this 
first vector and the procedure is restarted. 

If the first element is not inversely dominated by any 
other on the list, we know that it is efficient and we con- 
tinue the procedure by going to the second element. 

Although this method is very simple, it is not necessa- 
rily inferior to the others, because where we find a good 
efficient point, we will eliminate a lot of feasible solutions 
in the list by direct dominance. 

Another feature of this algorithm is that when in the 
comparison of two solutions, if a component of the first vac- 
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tor is greater than its corresponding one in the second vec- 
tor and another component of the second vector is greater than 
its corresponding one in the first vector, we do not continue 
making more comparisons. 

The drawback of this procedure is the dimension of EF, 
since all the feasible points of the problem are included on 
the list. Then, the capacity of the computer will be the 
cut off point of the method. 

DT 3 

Another way to perform the dominance test, and a good 
compromise between the last two procedures is the following; 

Each time v;e find a feasible point we perform direct 
dominance. Then, if the feasible solution is dominated by 
any of the points already on the list it is deleted. Other- 
wise, we include it in the list without further consideration. 

At the end of the algorithm we perform dominance to find 
all the efficient points. 

Since we have previously found some lower bounds that, 
as we will see, are good efficient points, this procedure can 


109 



perform well and has the advantage of a low dimension matrix 
EF. 


3 . 2 A Revised Enumeration Algorithm 

Having studied the different parts of an implicit enu- 
meration algorithm we can new try to construct it. We pre- 
sent below a rough scheme of what we need to do (Figure 7) : 


(I) Find efficient points over unit cube (A) . 

EF(A) = UB(A) U LB(A). Those that are feasible in our 
problem we will call LB (A) and the others U3(A) . 


(II) INITIALIZATION . At v^ . we know that = LB (A) and 

z = 00 and we want to find EF(P) that x-re know can 
o 

be written as: EF(P) = L3(A) U R.D, where RD has to 

dominated by UB(A). Go to s p (III). 


(Ill) EOUZTDS . At Vi^ we find as follows : 


+ UB(F) 
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Note that if we find an efficient point of our ori- 


ginal problem (P) , we can form z,^= LB (A) U VEF(P). 

(IV) FATHOMING . If for any constraint i 

A) t^> 

B) ^ 

C) z^>UB(A) 

is fathomed and we go to step V. If is live 
go to step VI. 

(V) BACKTRACKING . If no live vertex exists, go to step 
VII, other>7ise branch to the newest live vertex and 
go to step III. 

(VI) PARTITIONING AMD BRANCHING . 

(VII) TER^ilNATION . We have found a set of points among 

which we have the set of efficient points. By ap- 
plying the definition of efficiency among them, we 
will obtain EF(P) = LB (A) U RD . 


Ill 



FIGURE 7. 
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SECTION 4 


THE ALGORITIEI 


4 . 1 The Program 

The algorithm coded in Fortran IV is based on a Simple 
Implicit En’jmeration Algorithm with some modifications that 
we have already discussed in the last chapter. 

The first algorithm coded is the one described in sec- 
tion 4.2. Afterwards, several improvements in finding lower 
bounds and in performing dominance tests X'7ere made. A second 
algorithm! is obtained and computational results are reported. 

The procedure is as follows: At each vector or node we 

choose a variable to be fixed and v;e branch on it. We con- 
tinue the procedure until the point is fathomed at some stage 
of the problem, by feasibility (constraints or bounding) , or 
we arrive at an end point, where we test dominance. 

We therefore have three types of nodes; The Root Mode, 
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Intermediate Nodes, and End Nodes. Now we need to charac- 
terize each type of node. 


ROOT NODS. 

FEASIBLE: 

BPANCH 



INFEASIBLE: 

STOP . (IMEF 

FICIENT) 

INTERMEDIATE NODES . 

FEASIBLE: 

BRANCH 



INFEASIBLE: 

BACKTPJ^. CK . 

(DISCAPJ)) 

END NODES. 

FEASIBLE: 

BACKTPACK . 

(ADD POINT) 


INFEASIBLE: 

BACKTRACK . 

(DISCARD) 


DOMINATED: 

BACKTPJICK. 

(DISCARD) 


So, we need a variable to differentiate each kind of 
node. To do this we create variable LEV (level in the tree). 
For a problem with n components: 


LEV (ROOT) = 0 

0 < LEV (INTERHEDIATE NODE) < n 
LEV (EITO NODS) = n 

It is clear that for branching we only have to do 
LEV=LEV+1 and for backtracking LEV=LEV-1. 
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Once that we know how to distinguish between nodes x-;e 
need to know xjhich variables have been set and to which value. 
To do this, we need tx^o more variables: 

VAR(i) . Only LEV entries are significant. 

VAL(i). Only LEV entries are significant. 

VAR indicates the variable that has been set to any spe- 
cific value at each step. VAR is then a vector of components 

i=l, . . . ,LEV. 

VAL indicates the value to which every selected variable 
has been set. It is also a vector of components i=l,...,LEV. 
Both vectors work together and inform us, x^7hich variable 
has been set and to x^hat value, at each step of the problem. 
We have to UPDATE VAR and VAL x/nen we BACKTPACK and BFAWCH. 

Still, we have to determine xvhat values a variable can 
take. Although only two values are possible, zero and one, 
it is necessary to differentiate between variables set by 
branching or by bounding on variables. Because, in this last 
case the variable is set to zero or one definitely and xjhcn 
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we backtrack we will pass over them. 

Thus, the value that a variable i can take at stage k 
is : 

VAR(k) = i 

VAL(k) =0. has value 0 by BRANCHING 

VAL(k) =1. x^ has value 1 by BRANCHING 

VAL(k) =2, x^ has value 0 by BOUNDING 

VAL(k) =3. x^ has value 1 by BOUNDING 

This solves the problem of recognising a variable when 
we backtrack. Backtracking will go backward in the branch 
until we find a variable whose value is zero or one. If the 
variable has a value of two or three we pass over it. 


^■Then we arrive at a variable set to zero or one we will 
take its opposite value but without repeating the same vari- 
able. We proceed as follows: If at stage k, variable x^ has 

VAL(k)=0, when we complete the backtracking we set x^ to one, 
and put VAL(k)=3. If variable x^ has VAL(k)=l, when we com- 
plete the backtracking we set x^ to zero and we put VAL(k)=2. 
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Branching chooses a variable not among the first LEV 
variables in VAR according to rules that we will discuss la- 
ter. 


In order to know if a variable is free or fixed, we have 
to look over the whole vector VAR.(k) . In order to avoid this, 
we keep another n-vector S(j). For each variable j, S(j) has 

two values: zero if x. is free and one if it is fixed. 

3 

Finally, we need to know at each step of the algorithm, 
the value of the objective functions as well as the values 
of the RKS ’ s of the constraint matrix. To achieve this, we 
use two more n-vectors: Z(i) representing the sim of the co- 

efficients of objective i (i=l,...,p) for all variables fixed 
to one (j £ S,, . ) and S(i) denoting the PJIS vector of the con- 
straint i (i=l,...,m). 

Therefore, we need to keep track of Z(i) and B(i) 
throughout the problem. This raises the necessity of upda- 
ting not only LEV, VAR., VAL, and S , but also Z and B, each 
time we branch on certain variables or as we shall see when 
we backtrack in the algorithm. 
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4 . 2 The First Algorithm 

As we can see in the block diagram shown below we have 
a series of subroutines such as finding loxjer bounds, feasi- 
bility, backtracking, branching and dominance which we shall 
now explain (Figure 8) : 

The matrix EF is the matrix of feasible points which at 
the beginning of the algorithm represents the set of lower 
bounds and at the end will give us the set of efficient points. 
I^hen we arrive at an end branch (LEV=n) still feasible, we 
add the point to this matrix EF. This is represented by 
EF = EF U Z , where Z, as we have seen, is the vector of the 
values of each objective. 


4.2.1 Finding Lower Bounds 

In this first algorithm we have coded a simpler version 
of the unit hypercube method of finding lower bounds discussed 
in Chapter III. This approach performed well in the initial 
stages of development. Later, when we began to use objective 
functions with all positive coefficients, the only lower bound 
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found was the vector of one's which, on the other hand, was 
usually infeasible. 

Although the procedure already discussed could give us 
all the efficient points of the auxiliary problem, we opted 
for coding a less complicated and undoubtedly less time con 
suming approach. 


As we show in the following block diagram, we only find 
some of the efficient points of the unit hypercube, the ones 
most easy to find, by maximizing each one of the objective 
functions. This way we do not have to test dominance and we 
only test feasibility. If the point is feasible, we keep it 
in the matrix EF of future efficient points, and if not, we 
disregard it (Figure 9) . 


This subroutine begins by finding the matrix V, accor- 
ding to the sign of the coefficients c^^ of the objective 
functions (we do not consider in this first approach c..=0). 
We take v.,=l if c. . > 0 and v. .=0 if c..< 0. .Afterwards, we 




3-J 


3-J 


eliminate all the rows of V that have identical components. 
Finally, we test feasibility and from the vectors that are 


120 


















feasible, we find the value of the objective functions which 
will initiate the matrix of efficient points EF. 

The procedure of eliminating a row of the matrix is to 
simply transfer the last point of the matrix to this row and 
reduce the matrix nuimber of rows by one. 

4.2.2 Feasibility 

Among the four procedures discussed for this subroutine 
on page 86-96, we decide to code the number four. 

The next block diagram demonstrates how the set of con- 
straints is divided into two categories, depending upon the 
sign of its RIIS . If the RHS is negative we test feasibility 
and find the lower bound for the most negative variable and 
the upper bound for the most positive one. If the RHS is po- 
sitive, we test to see if the constraint set is feasible and 
also find the upper bound for the most positive variable (Fig. 10) 

If, in any of the constraints, the sum of its negative 
coefficients (SA!T) is greater than the RHS (for b(i) < 0) the 
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problem is infeasible (binary variable F=0) . If all the con- 
straints are feasible, the nroblem is feasible at this stage 
(F=l) . 


Note, that when we have LEV=n, (end of a branch), the 
procedure will perform in the same way. In this case, there 
will not be any LHS , therefore SAN = SAP = 0. (SAP is the 
sxim of all positive coefficients of a given row constraint). 
Thus, if any RHS is negative the problem is infeasible, and 
if all RHS ' s are positive the problem is feasible. 


4.2.3 Branching 

The next flov; chart shows how we apply the third bran- 
ching rule (BR3), discussed in the last chapter (Figure 11). 

We use a binary variable IS which tells us if all the 
RHS ' s are positive (IS=1) or if at least one RHS is negative 
(IS=0) . Since we finished subroutine feasibility ending up 
with the sum of the negative elements SAN(i) for each row i, 
as well as the sum of the positive elements SAP(i), we do not 
have to find them again. In order to know if a variable, j, 
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FIGURE 11 


BRANCHING 




L25 


t* CD 



RETURN 














is fixed or free we use the end vector S(j) previously de- 
fined. 

One essential point in the last two subroutines is the 
problem of updating the algorithm each time we set a vari- 
able to zero or one. If we set a variable to zero we do not 
have to update anything because neither the RHS, B(i), nor 
the solution of the problem at stage k, Z(i) will change. 

The problem arises x>7hen we set a variable to one. In 
this case, Xi7e have to change the R.HS ' s of the constraints by 
the amount of the coefficient of the respective fixed vari- 
able and at the same time find the new vector value Z(i) of 
the solution of the problem at stage k+l. This kind of up- 
dating subrouting is called in the program DATEl, in order to 
differentiate it from the updating problem that x-zill appear 
in backtracking. 


4.2.4 Backtracking 

The backtracking subroutine, as its name indicates, con- 
sists of going backwards in the branch of the tree until \-7e 
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FIGURE 12. 


3ACKTRA.CKIUG 
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find a variable in which it is feasible to branch. Thus, 
we backtrack until we find a variable that has taken one of 
its two possible values (0 or 1 by branching) , and automa- 
tically we set it to its opposite value (1 or 0) (Figure 12) . 

One essential point in the backtracking is the updating 
problem that appears when we go through a variable which ei- 
ther has taken its two possible values or it's set by boun- 
ding to a specific value. Note, that those variables are 
easily recognized because their current value is 2 or 3 as 
we pointed out on page 116. 

If the value is 2, which means 0 by bounding, we do not 
have to update anything. If the value is 3, which means 1, 
we have to update exactly in the opposite way as we did in 
branching. This updating procedure is called in the program 
DATE 2. 


Tvnen "vre branch we have to update the problem again as 
we did in branching. If t’ne value is 0 we will set the vari- 
able to 3 in order to show that it has taken its two possible 
values, and update with DATEl. If the value is 1 we will set 
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the variable to 2 and update with DATE2. This way, v;hen we 
backtrack we will pass over the variables that have taken 
their two possible values and we will not repeat them in the 
branching . 


4.2.5 Bounding 

At a given stage of the problem we will have a set of 
lower bounds which is located in the matrix EF. They are not 
only the lower bounds found at the beginning of the algorithm, 
but also every feasible point currently found in the proce- 
dure . 


At the same stage, we have the vector value Z(i) (i=l,...,p) 
of the solution of the problem at stage k. Then, we only have 
to look for the upper bound of the free variables UB(F) . The 
UB(F) that we coded here is found by setting each free vari- 
able to 1 if c. . > 0 or to 0 if c. . < 0. The upper bound of 
the whole problem UB will be UB = Z © UB(F) (Figure 13) . 

Thus, the problem v/ill be bounded (3=1) if all components 
of UB are less than or equal to any of the lower bounds of EF. 
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UNBOU:iDED 









Again, a variable j is easily recognized as free if S(j) 
is equal to zero. 

In this first algorithm, the bounding test is performed 
from the beginning of the problem (LSV=0) , with the only con- 
dition that there is at least one lower bound in the matrix 
EF (QtO) , where Q is the number of rov7S of this matrix at a 
given stage. 


4.2.6 Dominance Test 

The dominance test (direct and inverse) is performed at 
the end of the algorithm and for all feasible points of the 
problem. It is evident that if Q is equal to zero, there are 
no efficient points. If Q>1, we perform dominance among the 
row vectors (feasible points of the problem) in order to find 
the set of efficient points (Figure 14). 

We compare each row vector EF(i,h) h«l,...p; i=l,,..,Q-l, 
with all the others EF(j,h), h=l,...,p; j=i+l,...,Q, elimi- 
nating dominated vectors by the procedure indicated in the 
next flow chart . 
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FIGURE 14. 



/^iven a ROW rs 
EF(i,k)^EF(j,k) 
ALL k=l, . . . ,p 


ELIMINATE ROW j 
YES SET 

EF(j,k)=EF(Q,k) 
DO Q=Q-1 


X^iven a ROW 
EF(i,k)^EF(j,k) 
ALL k= 1 , . . . , p 


ELIMINATE ROW i 
JES get 

EF(i,k)=EF(Q,k) 
DO Q=Q-1 


NOW we have 
EF(i,k) >EF(j,k) 
SF(i,k')<EF(j,k') 
V k.k' 


i = i+1 


= j+1 










Note that once we have compared row vector i with all 
j's, this vector i and subsequently all the others before i, 
are already efficient. 

If we find that a component of a row vector i, is domi- 
nated while another dominates its corresponding one on a row 
vector j, we do not continue comparing these two vectors. 


4 . 3 The Second Algorithm 

The improvements of this second algorithm over the first 
one are sho^m below. A new block diagram is also given on 
the next page (Figure 15) . 

The first problem that arises in the algorithm just de- 
scribed is the method of finding good lower bounds. Since 
we were using objective functions with all its elements po- 
sitive, we had to use a method other than Che auxiliary pro- 
blem, and therefore we coded the A' s method of finding lower 
bounds . 

lie observed in the output of the first algorithm that 
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FIGURE 15. 

SECOND ALGORITHM 
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the bounding procedure was not working very efficiently. 

Since it was clear that the test was not bounding at the ear- 
lier stages of the problem, we began bounding after a certain 
number of levels. We reached the (n-5)^^ variable stage, 
without experimenting any change. 

At the same time we saw that we had obtained a very good 
lower bound by the X’s method. This lower bound not only 
was efficient but also very good for bounding (all components 
of approximately the same magnitude). Hence, the problem 
was that the upper bounds of the free variables were very 
high. 


Another drawback of the first algorithm was that we often 
exceeded the capacity of the computer, generally when v;e in- 
creased the size of the problem to eighteen or twenty vari- 
ables. In this case, the number of feasible points increased 
considerably and since we were performing dominance only at 
the end of the algorithm, the matrix EF of possible efficient 
points was getting bigger and bigger. In order to avoid this 
problem, we changed the dominance subroutine to the one de- 
scribed as DT3 in the last chapter. 
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4.3.1 Finding an Initial Lower Bound 


In this new algorithm we used the X' s method previously 
discussed. With different combinations of X' s we could find 
different lower bounds . 


For our problem of three objective functions we tried to 
find lower bounds over the whole set of possible efficient 
points. Then we used the follox-7ing vectors of X' s : 

\ = ( 1 , 1.1 ) 

\ = ( 3,1,1 ) 

A.J = ( 1,1,3 ) 

Each one of these X^ will give us one lower bound which 
hopefully will also be an efficient point. 


The procedure is described in the following block 
gram. We create a new row from the objective functions 
XI X,. c,; , for each k=l,2,... Since for all variables 
to zero, the problem is feasible if all coefficients of 


di.a“ 


e qual 
the 
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FIGURE 16. 


LOITER BOLLIDS 
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constraint matrix and the RHS's are positive, we begin by 
taking some variables equal to one, one at a time, until we 
reach infeasibility. In this case the last solution is the 
best that can be obtained (Figure 16) . 



1,2,... VARIABLES SET AT 1 

Note that it is possible the feasibility region could be 
empty, in which case we cannot find the lower bound. 

In general the procedure is not so simple. If we have 
RHS ' s positives and negatives, the solution with all variables 
set to zero is normally infeasible. Afterv7ards, the problem 
will become feasible when we have set enough negative vari- 
ables to one. Finally the problem will be infeasible again 
when some positive RHS constraint is not satisfied. In this 
case, the last solution is the best. 
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V 


1 


0 



1 . 2 , 


FEASIBLE 


INFEASIBLE 


VARIABLES SET AT 1 


4.3.2 Dominance Test 

Once we determine an efficient point (LSV=n and feasible) 
we add it to the list of lower bounds EF. If Q, the number 
of vector rows of this matrix is greater than one, we test to 
see if this new vector is dominated by any of the feasible 
points already on the list; and if so, we eliminate it by sim- 
ply doing Q=Q-1. If the feasible solution is not dominated, 
we continue the algorithm even knowing that this vector could 
itself dominate some other vector in the matrix. 

The advantage is that since we find good efficient points 
by the lower bound method, this procedure will in fact be very 
effective . 
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Still, at the end of the algorithm, we again have to per- 
form dominance, in order to find all the efficient points. 
Here, we use a slightly different approach than in the first 
algorithm. We use a binary variable IL which indicates to us 
if a component of the row vector i is dominated by its corres- 
ponding of j (IL=1) , which allows us, to continue the pro- 
cedure without comparing any more these two vectors i and j , 
in the moment we find another component of i that dominates 
its corresponding of j . 


4 . 4 Results and Comments 

The results presented in this section are separated into 
two categories. The first collection is the output of the 
first algorithm, while the second one is the output of the im- 
proved algorithm. 

In the very beginning the algorithm was tested with small 
problems whose solutions were already knox-m by solving them 
at the same time by a complete enumeration scheme. The data 
was entered in a file that was called by the program. 
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Once the algorithm was working properly, all the problems 
were generated randomly in the interval 0-100, except the PwHS 
of the constraint set that was fixed to a constant K times the 
sum of the coefficients of the row, (K was 0.25, 0.50 and 
0.75) . 

The time consumed in each problem was found by computing 
the difference between the CPU time before starting the sub- 
routine "Algorithm" and the CPU time just when the algorithm 
was finished and the subroutine returned to the main program 
to generate another problem. 

4.4.1 Results of the First Algorithm 

A first set of results is given in the tables #1, 
and #3. The problems were generated randomly with all com- 
ponents of C and A (objectives and constraints) positives. 

The size of the problem was: P, the number of objective 
functions equal 3; M, the number of constraints equal 8; and 
11, the number of variables equal to 10, 14, 18 and 20. 

Five problems were generated in each case, for different 
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TxVBLE #1 : RESULTS 


P=3 

K=0.75 

T 

IIPA 

NEP 

N=10 


3.96 

102 

10 

M=8 


35.26 

92 

25 



6.84 

71 

4 



10.08 

62 

6 



24.48 

107 

17 


K=0.50 

T 

NPA 

NEP 



23.76 

90 

16 



15.48 

54 

10 



11.16 

59 

7 



11.16 

50 

7 



15.48 

79 

10 


K=0.25 

n* 

X 

NPA 

NEP 


5.76 

13 

3 


3.64 

13 

5 


10.03 

a 

> 

6 


3.64 

13 

5 


2.88 

9 

1 
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TABLE 7^2: RESULTS 


P=3 

K=0 . 75 

T 

NPA 

MEP 

N=14 


73.44 

378 

46 

M=8 


16.9-2 

168 

11 



37.44 

233 

26 



24.48 

222 

15 



32.40 

240 

19 


K=0.50 

T 

MPA 

ME? 



42.12 

541 

22 



36.36 

319 

24 



22.32 

236 

15 



42.12 

430 

25 



90.0 

507 

26 


K=C.25 

T 

MPA 

MEP 



11.16 

61 

7 



9.00 

59 

5 



7,20 

33 

4 



6.21 

61 

3 



17.28 

72 

12 
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TABLE #3: RESULTS 


?=3 

K=0 . 25 

T 

MPA 

MEP 

N=13 


26.64 

228 

23 

11 

00 


25.92 

348 

20 



28.30 

312 

21 



38.16 

265 

28 



24.48 

332 

IS 


P=3 

K=0.25 

T 

MPA 

MEP 

M=20 


32.40 

412 

14 

00 

II 


71.64 

640 

16 



54.72 

523 

28 



29.16 

382 

12 



74.16 

745 

36 


AVEPJIGE 

K=0.25 

T* 

X 

MPA 

MEP 

M=10 


7.2 

11 

3 

M=14 


10.15 

57 

5 

II 

M 

CO 


28.80 

297 

22 

M=20 


52.42 

540 

21 
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Values of the RHS . The RHS was a factor K times the sum of 
the coefficient of the respective row. We vary K from 0.25, 
0.50 and 0.75. 

The principal problem with this algorithm is its number 
of feasible points (five to ten times the number of efficient 
points) which give us problems of computer capacity. 

T is the solution time in seconds, NPA is the number of 
points analyzed (feasible included in the list) and MEP is the 
total number of efficient points of the problem. 

The problems done in the least amount of CPU time were 
undoubtedly for K=0.25 whats seems reasonable given our method 
of branching. K=0.75 problems gave worse computational re- 
sults but we could reduce their CPU time by branching in just 
the opposite way that we did. K=0.50 problems were the worst 
of all cases analyzed. Given that result, we continued tes- 
ting problems with K=0.25, increasing the number of variables. 

In Table , we analyze problems with RHS equal to 0.25 
times the sum of the coefficients of the rows . The number of 
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variables was increased to 18 and 20. 

The last graph shows how the number of variables increa- 
ses the solution time. Therefore, our next goal is to try to 
decrease this CPU time, either by improving the algorithm or 
changing the structure of the problem. (Figure 17) . 


4.4.2 Results of the Improved Algorithm 

The results of the improved algorithm are presented in 
Tables #4 through #10. 

Two questions have to be answered at this point. How 
many lower bounds do we need to find by the X' s method, and 
where do we have to begin the bounding procedure? 

In Table #4, we test different problems for one and for 
two lower bounds. The inverse dominance test is performed 
each time we find a feasible point. The result is invariably 
an increase in the solution time. In some cases, generally 
in problems with K=0.25, we obtained the same lower bound for 
different X's, in part due to the small number of possible 
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TABLE =:^4 : RESULTS 


II 

K=0.75 

ONE LB 

TWO LB 

M=14 


66.60 

67.68 

M=4 


25.20 

28.44 



33.12 

41.04 



29.88 

33.48 



48.60 

53.04 


K=0.50 

ONE LB 

TWO LB 



83.52 

126.00 



18.72 

42.48 



22.68 

43.20 



35.64 

56.38 



136.44 

163.44 


K=0.25 

15.12 

19.44 



13.32 

15.84 



15.20 

19.08 



11.88 

14.76 



31.68 

34.92 
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efficient points of this case. 


We believe that the larger the number of efficient points 
of a problem, the larger the number of lower bounds that we 
can find without increasing the solution time. 

One positive fact was that the lower bound found was not 
only efficient but a good efficient, in the sense that it do- 
minates a large number of feasible points. 

In Table #5 v;e solve a series of problems, changing the 
beginning of the bounding procedure at different levels of the 
algorithm as a function of N, the number of variables of the 
problem. The inverse dominance test is performed each time 
we find a feasible point and only one lower bound is found by 
the 's method. 

We begin this test at levels 0, M/2, M/4, and M-5. The 
mrniber of times bounded was the same in all the cases, which 
tells us that the bounding test was not really bounding al- 
though the reduction in CPU time was in some cases of more 
than half the time employed in solving the problem 
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TABLE #5: RESULTS 


BOUNDING AT THE BEGINNING 


P=3 

K=0.25 

T 

NPA 

NEP 

N=20 


27.00 

49 

14 

M=8 


42.48 

52 

21 



29.16 

39 

12 



30.60 

32 

14 



63.72 

82 

36 


BOUNDING AFTER N/2 


T 

NPA 

NEP 

26.28 

49 

14 

41.76 

52 

21 

27.72 

39 

12 

29.88 

32 

14 

62.64 

82 

36 

BOUNDI 

NG AFTER 

N-5 

T 

NPA 

MTT'D 

16.72 

49 

14 

19.00 

52 

21 

16.76 

50 

12 

14.80 

32 

14 

21.30 

32 

36 
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Over the N-5 level, the number of times bounded went up 
due to the effect of bounding late, given that the number of 
branches increases by a factor of two in each step. For ex- 
ample, if one branch were to be bounded at stage k of the pro- 
blem but instead we bound at stage k+1, we will have to bound 
twice instead of once. At stage k+2 we will have to bound 
four times and so on. 

As we have discussed, the problem of bounding tests is 
the upper bound. Given that the lower bound found by the X' s 
method was very good, the only explanation for this failure 
is that the upper bound was very large. A way to solve this, 
is by finding a tighter upper bound by any of the other me- 
thods dicussed in Chapter III, taking always into account the 
problem of the time consumed in finding these new upper bounds. 

In Tables #6-10 we analyse the performances of the second 
algorithm. The improvements over the first algorithm are 
again: 

-inverse dominance each time 
-1 LB found by the X' s method 
-bounding after the (N-5) variable 
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TABLE #6: RESULTS 


P=3 

K=0 . 75 

T 

NPA 

NEP 

N=10 


2.02 

43 

10 

M=S 


2.09 

36 

25 



1.35 

22 

4 



1.47 

17 

6 



2.23 

40 

18 


K=0.50 

T 

NPA 

NEP 



1.50 

35 

14 



1.06 

10 

10 



0.93 

20 

7 



0.98 

10 

7 



1.32 

31 

10 


K=0.25 

T 

UPA 

NEP 



0.22 

8 

3 



0.25 

8 

5 



0.22 

6 

6 



0.22 

8 . 

5 



0.17 

n 

.4 

1 
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TABLE #7 : RESULTS 



P=3 

K=0 . 75 

T 

NPA 

NEP 

m 

M=14 


20.08 

111 

55 


M=8 


13.80 

30 

11 




15.63 

61 

26 




15.36 

44 

15 




17.08 

62 

20 



K=0.5C 

T 

KPA 

NEP 




15.26 

118 

32 

*. 



10.82 

45 

20 

n 



8.94 

44 

15 




14.70 

87 

22 




17.34 

109 

62 



K=0.25 

T 

NPA 

NEP 




1.03 

15 

7 




1.08 

7 

5 




0.73 

7 

4 




1.09 

12 





1.25 

20 

11 
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TABLE #8: RESULTS 


P=3 

K=0 . 75 

T 

NPA 

NEP 

N=18 


355 

- 

26 

M=8 


223 

- 

36 



194 

- 

28 



204 

- 

62 



246 

- 

44 


K=0.50 

T 

NPA 

NEP 



216 

- 

22 



195 

228 

54 



148 

179 

31 



138 

119 

51 



195 

232 

36 


K=0 . 25 

T 

NPA 

NEP 



6.39 

54 

23 



8.20 

37 

13 



8.00 

90 

41 



8.00 

40 

IS 



8.00 

51 

20 
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TABLE # 9 : RESULTS 


P=3 

K=0 . 25 

T 

NPA 

NEP 

N=20 


16.72 

49 

14 

H=8 


19.00 

52 

21 



16.76 

50 

12 



14.80 

32 

14 



21.30 

82 

36 


II 

U) 

K=0 . 25 

T 

NPA 

NEP 

M=23 


66.70 

81 

24 

H=8 


72.40 

67 

16 



80.00 

117 

50 



77.30 

54 

23 



104.40 

171 

60 


II 

K=0.25 

T 

MPA 

NEP 

N=25 


229 

- 

50 

It 

CO 


215 

- 

45 



170 

- 

28 



250 

- 

56 



290 


76 


155 



FIGURE 18. 


THE SECOND ALGORITHM 




TIME 

N=10 

0.22 

N=14 

1.04 

N=1S 

1 .11 

N=20 

17.20 

11=23 

30.16 

M=25 

216.22 
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With this improved algorithm, we have reduced the number 
of feasible points substantially, to a level of an average of 
two or three times the nimiber of efficient points which redu- 
ces our problem of computer capacity. 

In table #9 and #10, we analyze the problem for K«0,25, 
increasing the number of variables to 20, 23 and 25. It seems 
clear, after seeing in Figure 18 that the solution time is 
increased exponentially with the number of variables. Wnat 
is not so clear, is how the number of constraints will increase 
the solution time. Will it be linear as in the case of only 
one objective, or will it also be exponential? 

Another interesting issue to analyze is the number of 
variables set at one in a typical efficient point. Below, we 
give a list of the number of one's versus the size of the pro- 
blem: 


Since our branching rule preferentially sets variables 
to 0, our algorithm works better for 0.25 problems. If we 
change the branching rule to 1, the algorithm will work bet- 
ter for 0.75 problems. 
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APPROXIMATE MTOIBER OF 


P=3 

M=8 

N=10 

N=14 

K=18 

N=20 

N=23 

N=25 


VARIABLES SET AT 1 


K=0 . 75 
6 
9 

10 


K=0.50 

3 

5 

7 


K=0.25 

1 

2 

3 

4 

5 

6 


4 . 5 Comparisons and Suggestions 

No one at the present moment has been able to solve pro- 
blems up to 25 variables and 8 constraints. Bitran [lo] has 
solved problems of the size P=3, N=18 and M=4 , and Villarreal 
and Karwan [44] problems with P=3 , N=14 and M=4. We conclude 
then, that the algorithm has been a relative success, although 
the solution time at N=25 was already very large. The real 
drawback of the algorithm is for K=0.50 of the sum of the co- 
efficients of the rows . In this case we only could arrive at 
IS variables . 
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We have also seen that the algorithm increases the solu- 
tion time exponentially with the number of variables, and most 
likely also with the number of constraints. The future de- 
velopment of this algorithm has to shift this point as far as 
possible. Avenues for future research are the determination 
of better upper bounds of the free variables and the analysis 
of problems with special structures. 

Another topic to be explored and that could be rewarding 
is a decomposition technique that could permit the solution 
of problems through a sequence of smaller problems, taking 
advantage of the significant reduction in computing time. 
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APPENDIX 


ALGORITHM PRINTOUT AND TYPICAL OUTPUT 


In pages 165 through 170 we present the printouts for 
the algorithm described in section 4 . The algorithm is 
presented as a subroutine of a Main Program (page 171) which 
is the generator of random problems. 

The resulting output is shown on page 172. The imputs 
are the following: P, the number of objective functions, 

M, the number of constraints, and N, the number of variables. 

F is the beginning of the interval in which the random problem 
is generated and D is the constant that, multiplied by the sum 
of the coefficient of each row, gives us the RHS . 

In the typical output shown on page 172, the lower bound 
indicates the first lower bound found. Besides the efficient 
points and the total time, the figure 49 indicates the total 
number of feasible points included in the list before testing 
direct dominance. 
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SUBROUTINE PE PE 
COMMON PyN?M?CyA?B 
INTEGER H .» P i* R ? 0 ? U i> y |i| R ;/ y A L * P" y S 
DIMENSION C(30y30> pA< 30?30) ?y(30y30) ?EFc;200y30) yB( 
1 SA < 30 ) y LA ( 5 y 5 ) y SC < 30 ) y S ( 30 ) y SAN ( 30 ) y SAP ( 30 ) y OAR ( 30 ) 
2 JP ( 30 ) y JO ( 30 ) y UBF ( 30 ) y UB ( 30 ) y Z < 30 ) 

50 1 FORMAT ( 3 1 1 0 y 5F 1 0 , 2/50 ( 3F1 0 . 2/ ) ) 

LAClyl )=--l 
LA(2y 1 )=1 
LA(3y 1)=1 
Q=:!. 

DO 13 R=lyQ 
DO 14 J^=lyN 

14 y ( RyJ )=:--0 

13 CONTINUE 

DO 19 R=ly« 

DO 10 J=1 yN 
SC< J)=0. 

DO 11 1-1 = 1 yP 

11 SC ( J ) =SC ( J ) +LA ( H y R ) tC < H y J ) 

10 CONTINUE 

15 CM=0, 

DO 12 J=lyN 

IF(y<Ry J) .EQ, 1) GO TO 12 
IF(CM»GE.SC( J) ) GO TO 12 
CM=SC < J ) 

MJC=J 

12 CONTINUE 
J=MJC 
V(RyJ)=l 

C LOOKING FOR FEASIBILITY 

DO 16 1=1 yM 
SAC I )=0. 

DO 17 J=lyN 

IF (y(Ry J) ,EQ,0) GO TO 17 
SA ( I ) =SA < I ) TA ( I y J ) 

17 CONTINUE 

IF (SA<I) yGT,B(I) ) GO TO IS 

16 CONTINUE 
GO TO 15 

1 5 J=M JC 

y ( R y J ) =0 

WRITE(ly7) 

7 F 0 R M A T < ' L 0 W £ R B 0 U N D '' ) 

WR I TE ( 1 y 5 1 1 ) C y ( R y J ) y J= 1 y N ) 

19 CONTINUE 

C FINDING A SET OF LOWER BOUNDS 

DO 20 R=lyQ 
DO 21 H=1 yP 
EF C R y H ) =0 , 

DO 22 J=lyN 

IF <U<Ry J) yEQyO) GO TO 22 
EF ( R y H ) =EF ( R y H ) +C < H y J > 

22 CONTINUE 
21 CONTINUE 
20 CONTINUE 


30) y 

y VAL(30) 


J 
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511 FORMAT- 10(1H ?I5)?/) 

7 1 1 FORMAT ( 1 0 < 1 H ? F 1 0 . 2 ) ? / ) 

C INITIALIZATION 

502 FORMAT (31 10) 

29 LEU==0 

DO 23 J=l!-N 

23 S<J)=0 

DO 24 H=1?P 

24 Z(H)=0» 

C PERFORMING FEASIBILITY 

55 IS=0 

DO 5S I-1.*M 

IF <Ba)*GE.O*) GO TO 43 
IS=1 

C FINDING ISAM 

SAN(I)=0» 

DO 27 J=1?N 

IF <S( J) ,EQ. 1 ) GO TO 27 
IF (A(I? J) ,GE,0, ) GO TO 27 
SAN ( I ) =SAN ( I ) -f-A < I ? J ) 

27 CONTINUE 

IF ( B (I ) -SAM < I ) ) 44 ? 45 ? 46 

44 F:=0 

GO TO 60 

45 DO 50 J=li-N 
IX=I 

IF (S(J),EQ,1) GO TO 50 
IF (Ad? J) .EQ.O, ) GO TO 50 
LEy=LEV+l 
S( J)=l 

IF (Ad? J) .GT,Od GO TO 4? 
VAR ( LEV ) - J 
VAL ( LEV ) =3 
C CALL DATEKJ) 

DO 101 H=1?P 
101 Z(H)=Z(H)-fC(H? J) 

DO 104 I=:1?M 
104 B(I)--=Bd)-Ad?J) 

I==IX 

GO TO 50 

49 VAR(LEV)=J 
VAL ( LEV ) =-2 

50 CONTINUE 
GO TO 55 

C PERFORMING I HQ 

46 AQ=()4 

DO 30 J=1?N 

IF (S(J),EQd) GO TO 30 
I F ( A Q ,LE, A ( I ? J ) ) G 0 T 0 3 0 
AQ=Ad?J) 

JQd )---=J 
30 CONTINUE 
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IF(AQ«EQ.O* ) GO TO 57 

C1=B<I)-SAN(I)-S-Aa 

XH=C1/AQ 

IF (XHJ-E»0,) GO TO 57 
IF (XH*GT*1») GO TO 44 
LEU=LEy-M 
J=JQ(I) 

S( J)=l 
UAR(LEV)=J 
yAL(LEV)=:3 
C CALL DATE.1. <J) 

no 102 H=1 jP 
102 Z(H)=2(H)-fC(H? J) 

DO 105 I-=lvM 
105 Ba)=E(I)-A(I?J) 

GO TO 55 

C PERFORMING I SAMP 

43 3AN(I)=0. 

SAP(I)=0, 

DO 35 J=1?N 

IF (S(J),EGM) GO TO 35 
IF (A<I?J)) 33? 35? 34 

33 SAN < I ) ^SAN (I ) -f A ( I ? J ) 

GO TO 35 

34 SAP ( I ) =SAP ( I ) fA (I ? J ) 

35 CONTINUE 

IFGSAPd) *EQtO» ) GO TO 58 
C PERFORM INF I UP 

57 AP==0, 

DO 36 J=1?N 

IF <S<J),EQ.l) GO TO 36 

IF (AP,GE*A(I? J) ) GO TO 36 

AP-A ( I ? J ) 

JP (I ) = J 

36 CONTINUE 

IF(AP» EO^Od GO TO 5S 
C2::=B(I)-3AN(I) 

XU^==C2/AP 

IF (XU,GE,1,0) GO TO 53 

IF (XU*LT*0*0) GO TO 44 

J-- JP ( I ) 

LEy==LEV+l 
yAR(LEy)^=J 
OAL < LEy ) =:=2 
S( J)--l 
GO TO 55 

58 CONTINUE 
F=1 

60 IFcF*EQ.l) GO TO 100 
250 IF (LEV.EQ.O) GO TO 200 
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C BACKTRACKING 

150 J='v»AR(LE0) 

IF (0AL(LEyKEQ*0) 00 TO 61 
IF <OAL(LEy) »EQ»1) GO TO 62 
S(J)=0 

IF (yAL(LEO> ♦EQ»2) GO TO 63 
C CALL DATE2(UAR<LEy) ) 

DO 111 H:=lyP 

111 Z(H)=2(H)-C(Wi- J) 

DO 113 I = 1.*M 

113 B(I)=B(I)-fA(I? J) 

63 LEy=LEV-l 

IF (LEV) 200^200!- 150 

61 VAL(LEV)-“3 

C CALL DATEl(J) 

DO 103 H=1?P 
103 Z(H)=Z(H)+C(H.v J) 

DO 106 I-~l:Mi 
106 B(I)=B(I)-A(If J) 

GO TO 65 

62 VAL(LEV)=2 

C CALL DATE2(VAR(LEV) ) 

DO 112 H=l!.p 

112 Z(H)=Z(H)-C(H? J) 

DO 114 1 = 1 «ri 

1 1 4 BCD =B ( I ) TA ( I ? J ) 

65 GO TO 55 

100 IF(LEV*ECKN) GO TO 300 

IF(LEV,L£* (N-5) ) GO TO 59 
C BOUNDING 

IF(Q*EQ.O) GO TO 59 
DO 63 H=l/P 
UBF(H)=0. 

DO 69 J=1?N 

IF (S(J)*EQ*1) GO TO 69 
IF (C(l~hJ)A.E,0,) GO TO 69 
UBF ( H ) =LiBF ( H ) -f C ( H y J ) 

69 CONTINUE 

UB(H)=Z(H)+UBF(H) 

69 CONTINUE 
DO 71 R=ls.Q 
DO 72 H=lyP 

IF(UBCH) ♦GT»EF(RyH) ) GO TO 71 

72 CONTINUE 
IB=1 

GO TO 73 
71 CONTINUE 
IB=0 

73 IF (IB.EQ.l) GO TO 250 
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C BRANCHING 

59 IF (IS^EQ^O) GO TO SI 
1 = 1 

77 IF (B(I)a.T*0,) GO TO 76 
I = IT1 
GO TO 77 

76 XMl=Bn:)-SANCI) 

IH=I 

73 I = I-fl 

IF (I*GT*iM) GO TO 80 

IF <B(I) ,GE,0» ) GO TO 73 

IF ( XM 1 ♦ LE . ( B a ) -SAN ( I ) ) ) GO TO 73 

X!M1=B<I)-SAN<I) 

IH=I 

GO TO 73 
80 I = Iii 
j=joa) 

LEV=LEOfl 
VAR ( LEV ) = J 
VAL(LEV)=0 
S( J)=l 
GO TO 90 

31 1 = 1 

83 IF (B(I).GE,0,) GO TO 32 
I = I-fl 
GO TO 33 

32 XM2= B(I)-SAN<I)-SAP(I) 

IM=I 

35 I=Ifl 

IF a^OTn'i) GO TO 36 
IF <Ba)J-.T,0,) GO TO 35 

IF < XM2 ♦ LE , ( B ( I ) -SAN ( I ) -SAP ( I ) ) ) GO TO 35 
XM2=B ( I ) -SAN ( I ) -SAP < I ) 

IM=I 

GO TO 35 
86 I=IH 

IF < SAP < I ) » NE . 0 » ) GO TO 33 
DO 39 J=1?N 
IF(S( J) *EQ,0)G0 TO 37 
39 CONTINUE 

83 J=JPa) 

37 LEV=LEV-M 
VAR<LEV)=J 
VAL<LEV)=1 
S< J)=l 

C CALL BATEKJ) 

DO 201 H=1?P 

201 Z(H)=Z(H)TC(H. J) 

DO 202 1 = 1 i-M 

202 B(I)=B(I)-A(I* J) 

90 GO TO 55 J 
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€ PERFORMING LBCEF) 

300 Q=Q-f,t 
R=Q 

DO 91 H=1?P 
91 EF(R?H)=Z(H) 

IF(Q*EQ,1) GO TO 150 
MQ=Q-1 

DO 166 R=lyNQ 
DO 167 H--=lrP 

IF(EF-:R?H) .,LT«£F(Q?H) ) GO TO 166 
167 CONTINUE 
0 = 0-1 
GO TO 150 
166 CONTINUE 
GO TO 150 

C PERFORMING EFFI 

200 IF<OtNE.O' GO TO 225 

URITE(li^226) 

226 FORMAT ( 'THERE NO EFFICIENTS') 

GO TO 227 

225 IF<Q.E0,1) GO TO 517 

URITEa?933) 

933 FORMAT (' O') 

WRITEd? 502)0 
R=1 

92 L=Rfl 

140 H=1 

IL=0 

94 IF<EF(R?H) ♦GT*EF(L!-H) ) GO TO 97 

I F ( EF < R ? H ) . EO * £F ( L y H ) ) GO TO 1 55 
IL=1 

155 H=H+1 

IF (H,LE,P) GO TO 94 
DO 96 H=1.P 
96 EF':RyH)=EFaiyH) 

0 = 0-1 ' 

GO TO 152 

97 IF(IL,E0*1) GO TO 93 

99 IF (EF(RyH) ,LT.EF(LyH) ) GO TO 93 
H=H-f 1 

IF (H»LE*P) GO TO 99 
DO 9S H=lyP 
90 EF<LyH)=EF((T.»H) 

0 = 0-1 
GO TO 153 
■93 L=L-fl 

153 IF<L^LE,Q) GO TO 140 
R=RM 

152 IF(R.LE, (G-l ) ) GO TO 92 
WRITE< 1.517) 

517 FORMAK 'EFFICIENTS' ) 

DO 524 R=lyQ 

524 WRITE< 1 ?711 ) CEF^RyH) yH=l ?P) 

227 RETURN 
END 
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MAIN PR0GRi\2^ 


INTEGER PjFP 
COMMON P?N?M.vC?hfB 

n I HENS ION C ■: 30 7 30 > ? A ( 30 ? 30 ) y NN ( 30 ) y PF ( 30 ) y SA ( 30 ) y B ( 30 ) ? DK ( 30 ) 

NN(1)=20 

NN(2)=23 

NNC3)=25 

FFa) = *l 

FF(2)===y3 

FF(3)-'=y5 

FF<4)==»7 

FF(5>=.9 

M=8 

n=:.25 

DO 10 L=l?2 
N=NN ( L ) 

DO 12 K=lyl 
F=FF(K) 

WRITE<lyl)P?NyMfFyD 
X=:RAND$A ( F ) 

DO 14 1=1 yp 
DO 15 J=1 yN 
X=RANDil5A < X ? 

X=100Ji<X 
15 C(IyJ)=X 

14 CONTINUE 

DO IS I=lyM 
SA(I)=Oy 
DO 17 J=lyN 
X=RAND$ACX) 

X=100>KX 
A < I y J ) =X 

SA < I ) =SA ( I ) 4 A ( I y J ) 

17 CONTINUE 

B<I)=DM<SA<I) 

15 CONTINUE 
WRITE(ly4> 

4 FORMAT <" P N H F D " ) 

1 FORMAT ( 3 1 1 0 y 2F 10.2) 

T1=CTIM$A(ICP) 

2 FORMAT (FIO. 2) 

CALL PEPE 
T2=CTIM$A(ICP) 

T=T2-T1 
WRITEC 1 y50) 

50 FORMAT ( ' TOTAL TInEO 
WRITE<ly2)T 
12 CONTINUE 

10 CONTINUE 

STOP 
END 
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TYPICAL OUTPUT 


TYPE OUTPUT 


OR :{<PACO 

3 

P 

1 LOWER BOUND 
0 0 


20 

N 


0 0 


8 0.1.0 0.25 

li I- D 


0 


0 


0 


0 0 0 1 


0 0 0 0 


0 0 


Q 

4? 


EFFIC.TEHTS 



232.97 

311 .51 

309.04 

208 . 05 

309.46 

318.55 

170.32 

334.60 

306 . 03 

244.27 

300 . 94 

224.43 

348.55 

156.38 

249.40 

272.50 

285.03 

309.91 

265.46 

299.38 

267.62 

345 .47 

167.29 

266.52 

203.28 

o o 6 . 0 o 

293.99 

214.07 

265.01 

331.01 

302.95 

249.06 

339.40 

295.91 

263. 4 1 

297 . 1 1 

. ^^4 

244.52 

4 0.8 S 

236.39 

319.34 

3 0 4 . 4 4 

312.16' 

246.03 

303.63 

TOTAL TIME 




1 7 ♦ 1 6 
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